Papers with downstream applications
NLP for Conversations: Sentiment, Summarization, and Group Dynamics (C18-3)
Copied to clipboard
| Challenge: | a tutorial focuses on computational models for conversational structure, summarization and sentiment detection, and group dynamics. |
| Approach: | a tutorial will provide examples of specific NLP tasks for conversational structure, summarization and sentiment detection, and group dynamics. |
| Outcome: | The tutorial focuses on the three areas of conversational structure, summarization and sentiment detection, and group dynamics. |
XNLP: An Interactive Demonstration System for Universal Structured NLP (2024.acl-demos)
Copied to clipboard
| Challenge: | Structured Natural Language Processing (XNLP) is an important subset of NLP that entails understanding the underlying semantic or syntactic structure of texts. |
| Approach: | They propose a XNLP demonstration system that leverages LLM to achieve universal XnLP with one model for all with high generalizability. |
| Outcome: | The proposed system advances in multiple aspects, including universal XNLP modeling, high performance, interpretability, scalability, and interactivity. |
Discourse Analysis and Its Applications (P19-4)
Copied to clipboard
| Challenge: | Discourse processing is a suite of NLP tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Approach: | They present a set of tasks to uncover linguistic structures from texts at several levels, which can support many downstream applications. |
| Outcome: | The tutorial covers the basic concepts of discourse analysis and linguistic structures in monologue vs. conversation, synchronous v. asynchronous conversation, and key linguistic structure in discourse analysis. |
Modular and Parameter-Efficient Fine-Tuning for NLP Models (2022.emnlp-tutorials)
Copied to clipboard
| Challenge: | State-of-the-art language models in NLP perform best when fine-tuned even on small datasets. |
| Approach: | They provide an overview of parameter-efficient fine-tuning methods and highlight similarities and differences . they highlight benefits and usage scenarios of a neglected property of parameter efficient models . |
| Outcome: | This paper provides an overview of parameter-efficient fine-tuning methods . it highlights similarities and differences by presenting them in a unified view . |
Retrieval-based Language Models and Applications (2023.acl-tutorials)
Copied to clipboard
| Challenge: | In this tutorial, we will provide a comprehensive overview of retrieval-based language models. |
| Approach: | This tutorial will provide a comprehensive overview of recent advances in retrieval-based language models. |
| Outcome: | This tutorial will provide a comprehensive overview of recent advances in retrieval-based language models. |
Semantic Specialization of Distributional Word Vectors (D19-2)
Copied to clipboard
| Challenge: | Distributional word vectors conflate various paradigmatic and syntagmatic lexico-semantic relations. |
| Approach: | This tutorial provides an overview of specialization methods for distributional word vectors . a common solution is to include external lexico-semantic knowledge in a reshaped vector space . |
| Outcome: | This paper provides an overview of specialization methods for distributional word vectors . the most recent developments include a new method for asymmetric relations in Euclidean . |
EventPlus: A Temporal Event Understanding Pipeline (2021.naacl-demos)
Copied to clipboard
Mingyu Derek Ma, Jiao Sun, Mu Yang, Kung-Hsiang Huang, Nuan Wen, Shikhar Singh, Rujun Han, Nanyun Peng
| Challenge: | Event information is a type of common sense knowledge that helps people understand how stories evolve and provides predictive hints for future events. |
| Approach: | They propose a temporal event understanding pipeline that integrates state-of-the-art components. |
| Outcome: | The proposed pipeline can be easily adapted to other domains, including biomedical domains. |
pyBART: Evidence-based Syntactic Transformations for IE (2020.acl-demos)
Copied to clipboard
| Challenge: | Syntactic dependencies are designed to accurately reflect syntactical relations, but they do not make semantic relations explicit. |
| Approach: | They propose a Python library for converting English Enhanced UD trees to Enhanced or Enhanced representations. |
| Outcome: | The proposed representations are linguistically sound and make lexical relations explicit . the proposed representation scores higher than Enhanced UD graphs, while requiring fewer patterns. |
Learning Word Embeddings for Data Sparse and Sentiment Rich Data Sets (N18-4)
Copied to clipboard
| Challenge: | Existing word embeddings for sentiment analysis are limited in domain specific applications . generic word embeds are poor initialization for tasks on domain specific data sets. |
| Approach: | They propose to use word embeddings adapted for domain specific data sets in sentiment classification applications. |
| Outcome: | The proposed algorithms learn word embeddings on sparse and sentiment rich data sets. |
Ask-and-Verify: Span Candidate Generation and Verification for Attribute Value Extraction (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Existing reading comprehension models can over-generate attribute values which hinders precision. |
| Approach: | They propose a product attribute value extraction task that captures key factual information from product descriptions and a new end-to-end pipeline framework called Ask-and-Verify. |
| Outcome: | The proposed framework outperforms existing models by up to 3.1% F1 absolute improvement points while scaling to thousands of attributes. |
KG-FLIP: Knowledge-guided Fashion-domain Language-Image Pre-training for E-commerce (2023.acl-industry)
Copied to clipboard
| Challenge: | Various visionlanguage pre-training (VLP) models learn cross-modal alignment from large-scale well-aligned image-text datasets without leveraging external knowledge. |
| Approach: | They propose a knowledge-guided fashion-domain language-image pre-training framework that learns fine-grained representations in e-commerce domain and utilizes external knowledge to improve the pre-train efficiency. |
| Outcome: | The proposed framework outperforms state-of-the-art models on Amazon and Fashion-Gen datasets by large margins. |
Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks (2022.emnlp-industry)
Copied to clipboard
| Challenge: | Domain Classification (DC) and Intent Classification/Named Entity Recognition (ICNER) are the most common methods for reducing teacher-student knowledge into manageable sizes for low-latency downstream applications. |
| Approach: | They investigate whether distillation from a generic LM benefits downstream tasks . a domain classification and a task-specific data set are used to fine tune the model . |
| Outcome: | The proposed model improves across tasks and test sets when only task-specific data is used. |
ReasonGraph: Visualization of Reasoning Methods and Extended Inference Paths (2025.acl-demo)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) reasoning processes are complex and lack of organized visualization tools creates barriers to understanding, evaluation, and improvement. |
| Approach: | They propose a web-based platform for visualizing and analyzing LLM reasoning processes. |
| Outcome: | The proposed platform shows high parsing reliability, efficient processing, and excellent usability across various downstream applications. |
TransAgents: Build Your Translation Company with Language Agents (2024.emnlp-demo)
Copied to clipboard
| Challenge: | Multi-agent systems empowered by large language models have demonstrated remarkable capabilities in a wide range of downstream applications. |
| Approach: | They introduce a multi-agent translation system inspired by human translation companies . TransAgents employs specialized agents to collaboratively produce translations that are accurate . |
| Outcome: | The proposed system produces translations that are accurate, culturally sensitive, and of high quality. |
Tau-Eval: A Unified Evaluation Framework for Useful and Private Text Anonymization (2025.emnlp-demos)
Copied to clipboard
| Challenge: | Existing studies on text anonymization prioritize privacy preservation at the expense of utility, relying on reference-based metrics like ROUGE, BERTScore, or METEOR to measure textual fidelity. |
| Approach: | They propose an open-source framework for benchmarking text anonymization methods through the lens of privacy and utility task sensitivity. |
| Outcome: | The proposed framework is open-source and provides a Python library, documentation and tutorials. |
SPRING Goes Online: End-to-End AMR Parsing and Generation (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Abstract Meaning Representation (AMR) is a formalism for representing the semantics of natural language in a readable and hierarchical way. |
| Approach: | They present SPRING Online Services, a Web interface and RESTful APIs for their AMR parsing and generation system, SPRING (Symmetric PaRsIng aNd Generation). |
| Outcome: | The proposed system provides a highly interactive visualization platform and feedback mechanism to obtain user suggestions for further improvements of the system’s output. |
LEVEN: A Large-Scale Chinese Legal Event Detection Dataset (2022.findings-acl)
Copied to clipboard
Feng Yao, Chaojun Xiao, Xiaozhi Wang, Zhiyuan Liu, Lei Hou, Cunchao Tu, Juanzi Li, Yun Liu, Weixing Shen, Maosong Sun
| Challenge: | Existing legal event detection datasets only cover incomprehensive event types and have limited annotated data. |
| Approach: | They present a large-scale Chinese legal event detection dataset . they use legal events as side information to promote downstream applications . |
| Outcome: | The proposed method improves 2.2 points precision in low-resource judgment prediction and 1.5 points precision for unsupervised case retrieval. |
Multi-VQG: Generating Engaging Questions for Multiple Images (2022.emnlp-main)
Copied to clipboard
| Challenge: | Traditional visual question generation (VQG) focuses on single images, resulting in a limited ability to comprehend time-series information of the underlying event. |
| Approach: | They propose to generate engaging questions from multiple images using a visual question generation dataset and establish a series of baselines. |
| Outcome: | The proposed model builds stories behind the image sequence to allow for creativity and experience sharing and hence draw attention to downstream applications. |
Cross-Lingual Link Discovery for Under-Resourced Languages (2022.lrec-1)
Copied to clipboard
Michael Rosner, Sina Ahmadi, Elena-Simona Apostol, Julia Bosque-Gil, Christian Chiarcos, Milan Dojchinovski, Katerina Gkirtzou, Jorge Gracia, Dagmar Gromann, Chaya Liebeskind, Giedrė Valūnaitė Oleškevičienė, Gilles Sérasset, Ciprian-Octavian Truică
| Challenge: | Linked data paradigms can be used to solve under-resourced languages' problem of under-utilization of resources. |
| Approach: | They propose a paradigm for cross-lingual link discovery that can be applied to under-resourced languages . they argue that techniques for cross language linking can be readily applied . |
| Outcome: | The proposed technologies can be applied to under-resourced languages, the authors argue . the authors show that the Linked Data paradigm can be used to solve the problem . |
Journalist-in-the-Loop: Continuous Learning as a Service for Rumour Analysis (D19-3)
Copied to clipboard
| Challenge: | Existing rumour analysis tools do not scale due to the large volume and velocity of user generated content. |
| Approach: | They propose to use a web-based rumour analysis tool that can continuously learn from journalists and integrate it into existing tools and platforms. |
| Outcome: | The proposed system can be easily integrated as a service into existing tools and platforms used by journalists using a REST API. |
Multilingual and Code-Switched Sentence Ordering (2024.starsem-1)
Copied to clipboard
| Challenge: | Prior research has focused on English language structures and multilingual contexts . however, there are several shortcomings with specialized sentence ordering models and advanced Large Language Models like GPT-4. |
| Approach: | They propose a multilingual sentence order task that extends SO to diverse narratives across 12 languages and code-switched texts. |
| Outcome: | The proposed task extends SO to diverse narratives across 12 languages, including challenging code-switched texts. |
LinkNBed: Multi-Graph Representation Learning with Entity Linkage (P18-1)
Copied to clipboard
| Challenge: | Knowledge graphs have emerged as an important model for studying complex multi-relational data. |
| Approach: | They propose a deep relational learning framework that learns entity and relationship representations across multiple graphs. |
| Outcome: | The proposed framework improves on the state-of-the-art relational learning approaches and identifies entity linkage across graphs. |
On Measures of Biases and Harms in NLP (2022.findings-aacl)
Copied to clipboard
Sunipa Dev, Emily Sheng, Jieyu Zhao, Aubrie Amstutz, Jiao Sun, Yu Hou, Mattie Sanseverino, Jiin Kim, Akihiro Nishi, Nanyun Peng, Kai-Wei Chang
| Challenge: | Recent studies show that natural language processing (NLP) technologies propagate societal biases about demographic groups associated with attributes such as gender, race, and nationality. |
| Approach: | They propose a framework for harms and questions to help practitioners understand biases . they propose measurable measures to detect and mitigate biased groups . |
| Outcome: | The proposed framework provides a framework for harms and questions for practitioners to answer to guide the development of bias measures. |
WebQuality: A Large-scale Multi-modal Web Page Quality Assessment Dataset with Multiple Scoring Dimensions (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing studies on web page quality assessment neglect the aspect of web page content. |
| Approach: | They propose a Chinese dataset for web page quality assessment . the dataset includes over 65,000 detailed an-notations spanning four sub-dimensions . |
| Outcome: | The proposed dataset includes over 65,000 detailed an-notations spanning four sub-dimensions and incorporates elements such as HTML+CSS, text, and visual screenshot. |
string2string: A Modern Python Library for String-to-String Algorithms (2024.acl-demos)
Copied to clipboard
| Challenge: | Notable algorithms include the Smith-Waterman algorithm for pairwise local alignment, the Hirschberg algorithm for global alignment, and the Wagner-Fischer algorithm for edit distance. |
| Approach: | **string2string** is an open-source library that offers efficient algorithms for string-to-string problems. |
| Outcome: | **string2string** is an open-source library that offers efficient algorithms for string-to-string problems. |
Decontextualization: Making Sentences Stand-Alone (2021.tacl-1)
Copied to clipboard
| Challenge: | Taking excerpts of text can be problematic, as key pieces may not be explicit in a local window. |
| Approach: | They define a problem of sentence decontextualization by rewriting a sentence to be interpretable out of context while preserving its meaning. |
| Outcome: | The proposed method can be used in question answering and document understanding tasks. |
Leveraging Contextual Information for Effective Entity Salience Detection (2024.findings-naacl)
Copied to clipboard
Rajarshi Bhowmik, Marco Ponza, Atharva Tendle, Anant Gupta, Rebecca Jiang, Xingyu Lu, Qian Zhao, Daniel Preotiuc-Pietro
| Challenge: | Prior work on salient entity detection focused on machine learning models that require heavy feature engineering. |
| Approach: | They propose to fine-tune medium-sized language models with a cross-encoder style architecture to achieve significant performance gains over feature engineering approaches. |
| Outcome: | The proposed model fine-tunes medium-sized pre-trained language models with a cross-encoder style architecture yields substantial performance gains over feature engineering approaches. |
FinLLM-B: When Large Language Models Meet Financial Breakout Trading (2025.naacl-industry)
Copied to clipboard
| Challenge: | Existing methods for financial breakout detection are subpar, despite large data and knowledge required. |
| Approach: | They propose a financial breakout dataset and introduce FinLLM-B, a large language model for financial breakout detection. |
| Outcome: | The proposed model outperforms GPT-3.5 in the field of financial breakout detection. |
RecGPT: Generative Pre-training for Text-based Recommendation (2024.acl-short)
Copied to clipboard
| Challenge: | Existing models for text-based recommendation lack data sparsity and flexibility to capture fluctuations in user preferences over time. |
| Approach: | They present the first domain-adapted and fully-trained large language model for text-based recommendation. |
| Outcome: | The proposed model outperforms baseline models on rating prediction and sequential recommendation tasks. |
Coherent and Concise Radiology Report Generation via Context Specific Image Representations and Orthogonal Sentence States (2021.naacl-industry)
Copied to clipboard
| Challenge: | Neural models for text generation are often designed in an end-to-end fashion, limiting their practical usability in downstream applications. |
| Approach: | They propose a method to compute image representations specific to each sentential context and exploiting diverse sentence states to ensure topical continuity and content diversity of generated radiology reports. |
| Outcome: | The proposed method outperforms baselines on objective metrics and human evaluations by 18% and 29% respectively in the evaluation for informativeness and content ordering respectively. |
So Different Yet So Alike! Constrained Unsupervised Text Style Transfer (2022.acl-long)
Copied to clipboard
| Challenge: | Automated transfer of text between domains does not maintain other attributes between the source and translated text. |
| Approach: | They propose a method for automatic transfer of text between domains that preserves semantic content but changes other attributes. |
| Outcome: | The proposed method retains lexical, syntactic and domain-specific constraints between domains for multiple benchmark datasets, including ones where more than one attribute change. |
Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models? (2023.findings-eacl)
Copied to clipboard
Jielin Qiu, William Han, Jiacheng Zhu, Mengdi Xu, Michael Rosenberg, Emerson Liu, Douglas Weber, Ding Zhao
| Challenge: | Recent advances in Large Language Models (LLMs) have shown powerful ability in various downstream applications. |
| Approach: | They propose an approach for cardiovascular disease diagnosis and automatic ECG diagnosis report generation. |
| Outcome: | The proposed approach generates high-quality cardiac diagnosis reports and achieves competitive zero-shot classification performance even compared with supervised baselines. |
RedactOR: An LLM-Powered Framework for Automatic Clinical Data De-Identification (2025.acl-industry)
Copied to clipboard
Praphul Singh, Charlotte Dzialo, Jangwon Kim, Sumana Srivatsa, Irfan Bulu, Sri Gadde, Krishnaram Kenthapadi
| Challenge: | Existing de-identification methods suffer from recall errors, limited generalization, and inefficiencies, limiting their real-world applicability. |
| Approach: | They propose a multi-modal framework for de-identifying electronic health records using a retrieval-based entity relexicalization approach. |
| Outcome: | The proposed framework achieves competitive performance while optimizing token usage to reduce LLM costs. |
Lost in Overlap: Exploring Logit-based Watermark Collision in LLMs (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing watermarking methods embed imperceptible identifiers into text to address copyright concerns. |
| Approach: | They propose a new philosophy for watermark attacks that addresses watermark collision . they demonstrate that collision poses a threat to all logit-based watermark algorithms . |
| Outcome: | The proposed method improves watermark collision performance on top of other methods. |
AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are rapidly becoming more and more popular, but dealing with the potential harms associated with their deployment in real-world scenarios is still an open research question. |
| Approach: | They propose an automated approach for automated generation of adversarial evaluation datasets to test the safety of LLM generations on new downstream applications. |
| Outcome: | AART generates evaluation datasets with high diversity of content characteristics critical for effective adversarial testing. |
BeLLM: Backward Dependency Enhanced Large Language Model for Sentence Embeddings (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing LLMs adopt autoregressive architectures without explicit backward dependency modeling. |
| Approach: | They propose a backward dependency enhanced large language model that transforms attention layers from uni-to-bi-directional to learn sentence embeddings. |
| Outcome: | The proposed model achieves state-of-the-art performance in varying scenarios. |
Natural Language Processing for Human Resources: A Survey (2025.naacl-industry)
Copied to clipboard
| Challenge: | Recent advances in NLP have the potential to transform HR processes, from recruitment to employee management. |
| Approach: | They analyze key tasks such as information extraction and text classification and their roles in downstream applications like recommendation and language generation while discussing ethical concerns. |
| Outcome: | The proposed frameworks can be applied to HR tasks and to recommendation, language generation, and interaction. |
Y’all should read this! Identifying Plurality in Second-Person Personal Pronouns in English Texts (D19-55)
Copied to clipboard
| Challenge: | Various languages, such as Spanish, Hebrew, or French, have different words to distinguish between singular "you" and plural "you". |
| Approach: | They train a model to distinguish between the single/plural ‘you’ in English using in-domain training. |
| Outcome: | The proposed model achieves reasonable accuracy, but there is room for improvement in the domain-transfer scenario. |
VKIE: The Application of Key Information Extraction on Video Text (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing methods for extracting structured information from videos are coarse-grained at segment level and unable to capture finegrained information at the entity level. |
| Approach: | They propose a task for extracting hierarchical key information from visual texts on videos . they decouple the task into four subtasks and propose two implementation solutions . |
| Outcome: | The proposed solutions achieve remarkable performance and efficient inference speed on a well-defined dataset. |
Towards the First NLP Benchmark for Ladin - an Extremely Low-Resource Language (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are limited in low-resource languages due to lack of labeled training data. |
| Approach: | They propose to use Ladin as a model for sentiment analysis and question answering by incorporating Italian data into machine translation training. |
| Outcome: | The proposed method improves on existing Italian–Ladin translation baselines. |
How to Dissect a Muppet: The Structure of Transformer Embedding Spaces (2022.tacl-1)
Copied to clipboard
| Challenge: | Pretrained embeddings based on the Transformer architecture have taken the NLP community by storm . a novel decomposition of Transformer output embeddables is demonstrated . |
| Approach: | They propose to decompose Transformer output embeddings into a sum of vector factors . they show multi-head attentions and feed-forwards are not equally useful in downstream applications . |
| Outcome: | The proposed method outperforms recurrent architectures on a wide variety of tasks. |
CBAL: Context-Based Agentic Learning for Speaker Diarization Segmentation Refinement (2026.acl-srw)
Copied to clipboard
| Challenge: | Speaker diarization systems produce segmentation errors that degrade transcript readability and downstream applications. |
| Approach: | They propose a framework that refines segmentation boundaries in diarized scripts . they use a lightweight LLM agent to reason about merge decisions . |
| Outcome: | The proposed framework achieves 93.4% accuracy across 359 applied merges and reduces segment count by 6.1%. |
On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language Representations (2022.acl-short)
Copied to clipboard
Yang Trista Cao, Yada Pruksachatkun, Kai-Wei Chang, Rahul Gupta, Varun Kumar, Jwala Dhamala, Aram Galstyan
| Challenge: | Recent natural language processing systems use large language models as the backbone . however, societal biases are encoded in these models and transferred to downstream applications . |
| Approach: | They propose to use two categories to measure fairness in natural language processing tasks . they find intrinsic and extrinsic metrics do not correlate in their original setting . |
| Outcome: | The proposed metrics do not correlate in their original setting, the authors show . they find that they are not accurate when correcting for metric misalignments and noise . |
A Framework for Flexible Extraction of Clinical Event Contextual Properties from Electronic Health Records (2025.acl-industry)
Copied to clipboard
| Challenge: | EHRs contain vast amounts of valuable clinical data, stored as unstructured text. |
| Approach: | They propose a method that uses existing NER+L methods to classify medical entities at scale using a named entity recognition and linking task. |
| Outcome: | The proposed model outperforms Bi-LSTM in minority class tasks with up to 28% of the time and 32% faster training time. |
Measuring Social Biases in Masked Language Models by Proxy of Prediction Quality (2025.acl-long)
Copied to clipboard
| Challenge: | Innovative transformer-based language models produce contextually-aware token embeddings, but have been shown to encode unwanted biases for downstream applications. |
| Approach: | They extend previous work by evaluating social biases introduced after retraining an MLM under the masked language modeling objective and propose proxy functions within an iterative masking experiment to measure the quality of transformer models’ predictions. |
| Outcome: | The proposed proxy functions within an iterative masking experiment show that all transformer models encode concerning social biases. |
Adversarial Training for Satire Detection: Controlling for Confounding Variables (N19-1)
Copied to clipboard
| Challenge: | Existing methods for satire detection focus on satirical news based on article sources . satiric news are written with the aim of mimicking regular news in diction . |
| Approach: | They propose a model for satire detection with an adversarial component to control for the confounding variable of publication source. |
| Outcome: | The proposed model improves generalization performance to unseen publications with an adversarial component. |
Hard Negative Mining for Domain-Specific Retrieval in Enterprise Systems (2025.acl-industry)
Copied to clipboard
| Challenge: | Existing methods for lexical retrieval struggle due to semantic mismatches and overlapping terminologies, and ambiguous abbreviations common in specialized fields like finance and cloud computing. |
| Approach: | They propose a scalable hard-negative mining framework that dynamically selects semantically challenging but contextually irrelevant documents to enhance deployed re-ranking models. |
| Outcome: | The proposed framework improves on public domain datasets and shows that it is generalizable and ready for real-world applications. |
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing taxonomies focus on adding concepts to the leaf nodes of the existing tree, which does not fully utilize the taxonomy’s knowledge and is unable to update the original taxomy structure. |
| Approach: | They propose a two-stage method called ATTEMPT for taxonomy completion that inserts new concepts into the correct position by finding a parent node and labeling child nodes. |
| Outcome: | The proposed method performs best on taxonomy completion and extension tasks, surpassing existing methods. |
MultiMed: Multilingual Medical Speech Recognition via Attention Encoder Decoder (2025.acl-industry)
Copied to clipboard
Khai Le-Duc, Phuc Phan, Tan-Hanh Pham, Bach Phan Tat, Minh-Huong Ngo, Thanh Nguyen-Tang, Truong-Son Hy
| Challenge: | Multilingual automatic speech recognition (ASR) in the medical domain is a critical foundational task, serving a wide range of downstream applications such as speech translation, spoken language understanding, and voice-activated assistants. |
| Approach: | They present the first multilingual medical ASR dataset and the first collection of small-to-large end-to end medical APR models spanning five languages: Vietnamese, English, German, French, and Mandarin Chinese. |
| Outcome: | The proposed model covers Vietnamese, English, German, French, and Mandarin Chinese, and is the first multilingual ASR dataset across five languages. |
Can Authorship Representation Learning Capture Stylistic Features? (2023.tacl-1)
Copied to clipboard
Andrew Wang, Cristina Aggazzotti, Rebecca Kotula, Rafael Rivera Soto, Marcus Bishop, Nicholas Andrews
| Challenge: | Existing methods to disentangle an author's style from the content of their writing are limited by the reliance on human labels and the narrow focus of stylistic distinctions. |
| Approach: | They propose to use a surrogate task to learn authorship representations that are sensitive to writing style and to validate their hypothesis . |
| Outcome: | The proposed representations are sensitive to writing style and may be robust to topic drift over time. |
RGL: A Simple yet Effective Relation Graph Augmented Prompt-based Tuning Approach for Few-Shot Learning (2022.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) are a good starting point for downstream applications, but it is difficult to generalize them to new tasks given a few labeled samples. |
| Approach: | They propose to use Relation Graph augmented learning to improve the performance of few-shot natural language understanding tasks by rewriting the input sequence into a cloze question with masks. |
| Outcome: | Extensive experiments show that Relation Graph augmented learning (RGL) improves performance of prompt-based tuning strategies. |
Community Topic: Topic Model Inference by Consecutive Word Community Discovery (2022.coling-1)
Copied to clipboard
| Challenge: | a new topic modelling algorithm is developed to help researchers understand large corpora . community topic can be used to find coherent topics at various scales . |
| Approach: | They propose a topic-modeling algorithm that extracts communities from term co-occurrence networks and compares it with Latent Dirichlet Allocation and top2vec. |
| Outcome: | The proposed algorithm can find coherent topics at various scales. |
Recipe Instruction Semantics Corpus (RISeC): Resolving Semantic Structure and Zero Anaphora in Recipes (2020.aacl-main)
Copied to clipboard
| Challenge: | Existing approaches to understanding recipe instructions make assumptions that are domain specific. |
| Approach: | They propose a new dataset for information extraction on recipes . they avoid a priori pre-defining domain-specific predicates to recognize . instead, they focus on basic understanding of the expressed semantics . |
| Outcome: | The proposed dataset avoids a priori pre-defining domain-specific predicates to recognize . instead, it focuses on basic understanding of the expressed semantics rather than reducing them to a simplified state representation. |
MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers (2023.eacl-main)
Copied to clipboard
| Challenge: | Pre-trained Language Models (LMs) are an integral part of natural language processing but their usability is constrained by computational and time complexity and their increasing size. |
| Approach: | They propose a technique for converting knowledge of fully parameterised LMs into a compact recursive student. |
| Outcome: | The proposed models match the performance of bloated models with negligible performance losses. |
Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to measure stereotypes in large language models rely on manual templates or natural sentences that contain stereotypes. |
| Approach: | They propose a prompt-based method to measure stereotypes in large language models . they use natural language descriptions of the target demographic group alongside unmarked defaults . |
| Outcome: | The proposed method detects that portrayals contain higher rates of racial stereotypes than human-written portrayals. |
Temporal Validity Change Prediction (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing benchmarking tasks require models to identify temporal validity duration of a single statement . however, many data sources contain additional context, which may alter the duration of the original statement if the context is present . |
| Approach: | They propose a task benchmarking the ability of machine learning to detect context statements that induce such change. |
| Outcome: | The proposed task uses a dataset of temporal target statements and crowdsource corresponding context statements to benchmark them. |
A High Precision Pipeline for Financial Knowledge Graph Construction (2020.coling-main)
Copied to clipboard
Sarah Elhammadi, Laks V.S. Lakshmanan, Raymond Ng, Michael Simpson, Baoxing Huai, Zhefeng Wang, Lanjun Wang
| Challenge: | Knowledge graphs are a standard for structured knowledge representation in the Semantic Web. |
| Approach: | They propose to extract financial news articles into a knowledge graph by using a financial dictionary. |
| Outcome: | The proposed pipeline extracts 342,000 financial news articles with a precision of 78% at the top-100 extractions. |
Unsupervised Slot Schema Induction for Task-oriented Dialog (2022.naacl-main)
Copied to clipboard
| Challenge: | Defining task-specific schemas is the first step of building a task-oriented dialog system. |
| Approach: | They propose an unsupervised approach for slot schema induction from unlabeled dialog corpora using in-domain language models and unsupervised parsing structures. |
| Outcome: | The proposed method shows significant performance improvement on multi-domain and SGD datasets. |
Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs (2021.eacl-main)
Copied to clipboard
| Challenge: | Paraphrase generation requires many annotated paraphrase pairs, which are expensive to obtain. |
| Approach: | They propose a model that learns to disentangle the semantics and syntax of a sentence from unannotated texts. |
| Outcome: | The proposed model learns to disentangle the semantics and syntax of a sentence from a collection of unannotated texts. |
Diversity and Consistency: Exploring Visual Question-Answer Pair Generation (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing tasks to generate question-answer pairs from visual images are under-explored. |
| Approach: | They propose a task that targets question-answer pair generation from visual images. |
| Outcome: | The proposed model can generate diverse or consistent QAPs on two benchmarks. |
PhoBERT: Pre-trained language models for Vietnamese (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Experimental results show that PhoBERT outperforms the recent best pre-trained multilingual model XLM-R in multiple Vietnamese-specific NLP tasks. |
| Approach: | They present PhoBERT with two versions, Phobert-base and PhoBRET-large, which are pre-trained for Vietnamese. |
| Outcome: | The proposed model outperforms the best pre-trained model XLM-R and improves the state-of-the-art in multiple Vietnamese-specific NLP tasks including Part-of speech tagging, Dependency parsing, Named-entity recognition and Natural language inference. |
Learning Word Embeddings for Low-Resource Languages by PU Learning (N18-1)
Copied to clipboard
| Challenge: | Existing approaches to learn word embedding on a corpus with only a few million tokens are limited to low-resource languages. |
| Approach: | They propose to use a sparse co-occurrence matrix to factorize the co-existence matrix and validate the proposed approaches in four different languages. |
| Outcome: | The proposed model is validated in four different languages. |
Lessons from the Bible on Modern Topics: Low-Resource Multilingual Topic Model Evaluation (N18-1)
Copied to clipboard
| Challenge: | Existing metrics to evaluate multilingual topic quality are inadequate for multilingual document analysis. |
| Approach: | They propose a new intrinsic evaluation metric for multilingual topic models that correlates well with human judgments of multilingual coherence and performance in downstream applications. |
| Outcome: | The proposed model improves the performance of multilingual topic models in low-resource languages and with human judgments of multilinguistic topic coherence. |
Looking Beyond Sentence-Level Natural Language Inference for Question Answering and Text Summarization (2021.naacl-main)
Copied to clipboard
Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Lorraine Li, Pavan Kapanipathi, Kartik Talamadupula
| Challenge: | Large-scale, open Natural Language Inference datasets have catalyzed the development of NLI models that exhibit close to human-level performance, but the use of these models for other downstream NLP tasks has met with limited success. |
| Approach: | They use multiple-choice reading comprehension and checking factual correctness of textual summarization tasks to investigate potential reasons for this . authors leverage abundance of data from reading comprehension datasets into longer-premise NLI datasets to improve their models . |
| Outcome: | The proposed models outperform models trained on converted datasets due to the difference in premise lengths. |
Self-Improvement in Multimodal Large Language Models: A Survey (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Using data and data, self-improvement for Large Language Models has improved model capabilities without significantly increasing costs. |
| Approach: | This survey provides a comprehensive overview of self-improvement for Large Language Models . it includes commonly used evaluations and downstream applications . |
| Outcome: | The authors provide a comprehensive overview of self-improvement in Multimodal LLMs. |
Towards Understanding Task-agnostic Debiasing Through the Lenses of Intrinsic Bias and Forgetfulness (2024.findings-acl)
Copied to clipboard
Guangliang Liu, Milad Afshari, Xitong Zhang, Zhiyu Xue, Avrajit Ghosh, Bidhan Bashyal, Rongrong Wang, Kristen Johnson
| Challenge: | Debiasing Pretrained Language Models (PLMs) are task-agnostic and can be generalizable, but its impact on language modeling ability and the risk of relearning social biases remain as the two most significant challenges. |
| Approach: | They propose a framework which can Propagate Socially-fair Debiasing to Downstream Fine-tuning to alleviate the forgetting issue of PLMs by regularizing debiased attention heads based on the PLM’s bias levels from stages of pretraining and debiase. |
| Outcome: | The proposed framework can Propagate Socially-fair Debiasing to Downstream Fine-tuning, indicating that the ineffectiveness of debiase can be alleviated by overcoming the forgetting issue through regularizing successfully debiased attention heads based on the PLMs’ bias levels from stages of pretraining and debiases. |
MixQG: Neural Question Generation with Mixed Answer Types (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing neural question generation approaches focus on short factoid type of answers. |
| Approach: | They propose a neural question generator that trains a single generative model by combining multiple question types with different answer types. |
| Outcome: | The proposed model outperforms existing models in both seen and unseen domains and can generate questions with different cognitive levels when conditioned on different answer types. |
Debiasing Isn’t Enough! – on the Effectiveness of Debiasing MLMs and Their Social Biases in Downstream Tasks (2022.coling-1)
Copied to clipboard
| Challenge: | Existing measures for social bias evaluation are inadequate for MLMs to accurately evaluate the social biases in their systems. |
| Approach: | They propose task-agnostic intrinsic and task-specific extrinsic social bias evaluation measures for MLMs that use different methods to re-learn social biases during fine-tuning on downstream tasks. |
| Outcome: | The findings highlight the limitations of existing MLM bias evaluation measures and raise concerns on the deployment of MLMs in downstream applications using those measures. |
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios (2026.findings-acl)
Copied to clipboard
Changhao Pan, Rui Yang, Han Wang, Zhuan Zhou, Xuming He, Wenxiang Guo, Ziyue Jiang, Ruiqi Li, Yu Zhang, Chenyuhao Wen, Ke Lei, Xiang Yin, Jingyu Lu, Zhiyuan Zhu, Zhou Zhao
| Challenge: | Existing evaluation benchmarks for long-form speech are limited to limited domains, creating a significant gap with the diverse downstream applications. |
| Approach: | They propose a benchmark that decomposes "long-form speech quality" into specific, disentangled dimensions. |
| Outcome: | The proposed benchmark decomposes “long-form speech quality” into specific, disentangled dimensions. |
Large Language Models with Controllable Working Memory (2023.findings-acl)
Copied to clipboard
Daliang Li, Ankit Singh Rawat, Manzil Zaheer, Xin Wang, Michal Lukasik, Andreas Veit, Felix Yu, Sanjiv Kumar
| Challenge: | Large language models (LLMs) have led to a series of breakthroughs in natural language processing due to the massive amounts of world knowledge they memorize during pretraining. |
| Approach: | They propose a method to inject counterfactual and irrelevant contexts into standard supervised datasets to strengthen both controllability and robustness. |
| Outcome: | The proposed method improves controllability and robustness across model architectures and sizes. |
Learning and Evaluating Emotion Lexicons for 91 Languages (2020.acl-main)
Copied to clipboard
| Challenge: | Emotion lexicons describe the affective meaning of words but are limited in coverage for most languages. |
| Approach: | They propose a method for creating arbitrarily large emotion lexicons for any target language. |
| Outcome: | The proposed method exceeds human reliability for some languages and variables. |
Retrofitting Contextualized Word Embeddings with Paraphrases (D19-1)
Copied to clipboard
| Challenge: | Contextualized word embeddings can be useful for downstream applications, but they can be over-sensitive to contexts. |
| Approach: | They propose a method to retrofit contextualized word embeddings with paraphrases to minimize the variance of word representations on paraphrased contexts. |
| Outcome: | The proposed method improves on sentence classification and inference tasks. |
Toward Secure Tuning: Mitigating Security Risks from Instruction Fine-Tuning (2026.acl-long)
Copied to clipboard
Yanrui Du, Fenglei Fan, Sendong Zhao, Jiawei Cao, Ming Ma, Danyang Zhao, Shuren Qi, Ting Liu, Bing Qin
| Challenge: | Instruction Fine-Tuning (IFT) has emerged as a critical technique for customizing Large Language Models (LLMs) however, recent studies have revealed that IFT can compromise the built-in security mechanisms of LLMs, posing significant security risks. |
| Approach: | They propose a method that shifts learning burden onto security-robust parameters and propose 'warm-up' phase that preferentially trains Mods_Rob to learn low-level features with minimal security risk. |
| Outcome: | The proposed method reduces security risks without sacrificing performance gains across knowledge-intensive datasets. |
Adapter Pruning using Tropical Characterization (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on adapter pruning have not examined the optimal number of adapter parameters needed for downstream applications. |
| Approach: | They propose an adapter pruning approach that prunes adapter parameters without changing the orientation of underlying tropical hypersurfaces. |
| Outcome: | The proposed approach prunes adapter layers without changing the orientation of underlying tropical hypersurfaces. |
How much pretraining data do language models need to learn syntax? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Pretraining methods are convenient, but expensive in terms of time and resources. |
| Approach: | They investigate the impact of pretraining data size on the syntactic capabilities of RoBERTa by using syntaktic structural probes to determine whether models pretrained on more data encode a higher amount of syntastic information. |
| Outcome: | The proposed models perform better on part-of-speech tagging, dependency parsing and paraphrase identification. |
AtTGen: Attribute Tree Generation for Real-World Attribute Joint Extraction (2023.acl-long)
Copied to clipboard
| Challenge: | Attribute extraction aims to identify attribute names and the corresponding attribute values from descriptive texts. |
| Approach: | They propose a unified formulation for real-world attribute extraction application, where closed-world, open-world and semi-open attribute extraction tasks are modeled uniformly. |
| Outcome: | The proposed model outperforms existing methods on three datasets and outperformed existing methods by a large margin. |
A synthetic data approach for domain generalization of NLI models (2024.acl-long)
Copied to clipboard
| Challenge: | Natural Language Inference (NLI) datasets are important benchmark tasks for LLMs . however, their realistic performance on out-of-distribution/domain data is less well-understood . a T5-small model trained with our data improves around 7% on average compared to the best alternative dataset . |
| Approach: | They propose a new approach for generating NLI data in diverse domains and lengths . they show that models trained on this data have the best generalization to completely new downstream test settings . |
| Outcome: | The proposed model can be trained on datasets with high-quality examples with meaningful premises and high accuracy. |
Can Brain Signals Reveal Inner Alignment with Human Languages? (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Brain Signals, such as Electroencephalography, and human languages have been explored independently for many downstream tasks, however, the connection between them has not been well explored. |
| Approach: | They introduce a multimodal transformer alignment model to observe coordinated representations between EEG and language. |
| Outcome: | The proposed method achieved an F1-score improvement of 1.7% on ZuCo and 9.3% on Zuco datasets for sentiment analysis, and 7.4% on ZuCO for relation detection. |
On the Role of Entity and Event Level Conceptualization in Generalizable Reasoning: A Survey of Tasks, Methods, Applications, and Future Directions (2025.findings-emnlp)
Copied to clipboard
Weiqi Wang, Tianqing Fang, Haochen Shi, Baixuan Xu, Wenxuan Ding, Liyu Zhang, Wei Fan, Jiaxin Bai, Haoran Li, Xin Liu, Yangqiu Song
| Challenge: | Conceptualization is a fundamental element of human cognition and plays a pivotal role in generalizable reasoning. |
| Approach: | They propose to categorize different types of conceptualizations into four levels based on the types of instances being conceptualized. |
| Outcome: | The proposed categorization of different types of conceptualizations into four levels based on the types of instances being conceptualized . |
FourCorners: A Production Knowledge Graph Unifying Thailand’s Legal System (2026.acl-industry)
Copied to clipboard
| Challenge: | Thai legal data lacks standardized, machine-readable data formats . authors: combining legal data requires understanding structural relationships that no existing resource captures. |
| Approach: | They propose a unified temporal knowledge graph for Thai legal data . it integrates 3,840 laws with 87,394 Supreme Court decisions, updated daily . |
| Outcome: | The proposed graph integrates 3,840 laws with 87,394 Supreme Court decisions . it achieves Citation F1 of 0.812 versus 0.666 for practitioner-standard web search . |
Arabic Diacritization Using Morphologically Informed Character-Level Model (2024.lrec-main)
Copied to clipboard
Muhammad Morsy Elmallah, Mahmoud Reda, Kareem Darwish, Abdelrahman El-Sheikh, Ashraf Hatim Elneima, Murtadha Aljubran, Nouf Alsaeed, Reem Mohammed, Mohamed Al-Badrashiny
| Challenge: | Diacritics are typically omitted in Arabic writings and the reader needs to guess the proper diacritics as they are reading. |
| Approach: | They propose a morphologically informed character-level model that can recover both types of diacritics simultaneously. |
| Outcome: | The proposed model achieves lowest word-level diacritization error rate for Classical Arabic, MSA, and two dialectal Arabic texts. |
User-Level Race and Ethnicity Predictors from Twitter Text (C18-1)
Copied to clipboard
| Challenge: | Using social media text to identify user-level race and ethnicity is a useful tool for a range of downstream applications, including passive polling or quantifying demographic bias. |
| Approach: | They propose to collect data from social media users who self-report their race/ethnicity through a survey to develop models which accurately predict the membership of a user to the four largest racial and ethnic groups with up to .884 AUC. |
| Outcome: | The proposed models accurately predict the membership of a user to the four largest racial and ethnic groups with up to .884 AUC and make available to the research community. |
Knowledge Graph Embedding with Atrous Convolution and Residual Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods are complex and require time for training and inference. |
| Approach: | They propose an atrous convolution based knowledge graph embedding method that increases feature interactions by using atrous . they evaluate method on six benchmark datasets with different evaluation metrics . |
| Outcome: | The proposed method achieves better results on six benchmark datasets than state-of-the-art methods on most evaluation metrics. |
Neuralign: A Context-Aware, Cross-Lingual and Fully-Neural Sentence Alignment System for Long Texts (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing sentence alignment systems focus on auxiliary information such as document metadata and hyperparameter-sensitive techniques, and neglect the crucial role that context plays in the alignment process. |
| Approach: | They propose a context-aware, end-to-end and fully-neural architecture for sentence alignment that maps source and target sentences in long documents by contextualizing their sentence embeddings with respect to the other sentences in the document. |
| Outcome: | The proposed system maps source and target sentences in long documents by contextualizing their sentence embeddings with respect to the other sentences in the document. |
Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for data annotation use an aggressive approach prompting LLMs to determine a single gold label for each unlabeled sample. |
| Approach: | They propose a teacher-student framework that distills candidate annotations with a Small Language Model (SLM) they propose to use LLMs to generate and distill candidate annotation with slms to ensure unique labels are provided for downstream tasks. |
| Outcome: | The proposed method outperforms existing methods due to uncertainty in LLMs and is noisetolerant. |
LM-Cocktail: Resilient Tuning of Language Models via Model Merging (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models are continually fine-tuned to better support downstream applications. however, this operation may result in significant performance degeneration on general perspectives. |
| Approach: | They propose a method which enables pre-trained language models to stay resilient in general perspectives. |
| Outcome: | The proposed model achieves strong empirical performance in the whole scope of general tasks while preserving a superior capacity in its targeted domain. |
WESR: A Benchmark and Strong Baseline for Word-level Event-Speech Recognition (2026.findings-acl)
Copied to clipboard
Chenchen Yang, Kexin Huang, Liwei Fan, Qian Tu, Botian Jiang, Dong Zhang, Linqi Yin, Shimin Li, Zhaoye Fei, Qinyuan Cheng, Xipeng Qiu
| Challenge: | aaron carroll: the precise localization of non-verbal vocal events remains a critical yet under-explored challenge. carroll says current methods suffer from insufficient task definitions with limited category coverage. carrol: knowing exactly where an event occurred is not enough; knowing exactly what it happened is. |
| Approach: | They propose a taxonomy of 21 vocal events with a new categorization into discrete versus continuous types. |
| Outcome: | The proposed model disentangles ASR errors from event detection while maintaining ASR quality. |
MINERS: Multilingual Language Models as Semantic Retrievers (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing benchmarks have evaluated language models to evaluate their performance across a range of embedding tasks. |
| Approach: | They propose a benchmark to evaluate the robustness of multilingual language models in semantic retrieval tasks including bitext mining and classification via retrieval-augmented contexts. |
| Outcome: | The proposed framework evaluates the robustness of multilingual LMs in retrieval tasks across over 200 languages, including extremely low-resource languages in challenging cross-lingual and code-switching settings. |
Analyzing Bayesian Crosslingual Transfer in Topic Models (N19-1)
Copied to clipboard
| Challenge: | a theoretical analysis of crosslingual transfer in probabilistic topic models is presented . we use Gibbs sampling to quantify the loss of knowledge across languages . |
| Approach: | They propose a method to quantify the loss of knowledge across languages during crosslingual transfer in probabilistic topic models. |
| Outcome: | The proposed model quantifies the loss of knowledge across languages during this process . it is validated on a diverse set of five languages and discusses best practices for data collection and model design . |
GUMsley: Evaluating Entity Salience in Summarization for 12 English Genres (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing work on salient entity extraction relies on crowdsourcing or user statistics to derive labels for entities. |
| Approach: | They propose a dataset that defines salience using human summaries and shows high agreement between annotations based on whether a source entity is mentioned in the summary. |
| Outcome: | The proposed dataset shows that pre-trained models and zero-shot LLM prompting fail to capture salient entities in generated summaries. |
A New View of Multi-modal Language Analysis: Audio and Video Features as Text “Styles” (2021.eacl-main)
Copied to clipboard
| Challenge: | Fig. 1 shows how style-transferred multi-modal features can be used in sentiment analysis and emotion recognition. |
| Approach: | They propose to use adaptive normalization to impose style onto text to learn richer representations for multi-modal utterances. |
| Outcome: | The proposed model achieves performance on par with state-of-the-art but using less than a third of the model parameters. |
Joint Language Semantic and Structure Embedding for Knowledge Graph Completion (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods to complete knowledge triplets rely on structures or semantics, but use semantics to improve performance. |
| Approach: | They propose to embed semantics in the natural language description of knowledge triplets with their structure information. |
| Outcome: | The proposed method improves performance on knowledge graph benchmarks and on low-resource regimes. |
COVID-19 Named Entity Recognition for Vietnamese (2021.naacl-main)
Copied to clipboard
| Challenge: | a new dataset is being developed to help fight the COVID-19 pandemic . the dataset is annotated for the named entity recognition task with newly-defined entity types . |
| Approach: | They present the first manually-annotated COVID-19 domain-specific dataset for Vietnamese . their dataset is annotated for the named entity recognition task with newly-defined entity types . |
| Outcome: | The proposed dataset is the first manually-annotated COVID-19 domain-specific dataset for Vietnamese. |
Preposition Sense Disambiguation and Representation (D18-1)
Copied to clipboard
| Challenge: | Prepositions are highly polysemous and their variegated senses encode significant semantic information. |
| Approach: | They match each preposition’s context and their interplay to the geometry of the word vectors to the left and right of the preposition. |
| Outcome: | The proposed algorithm is comparable to and better than state-of-the-art on two benchmark datasets. |
Exploring the Relationship between In-Context Learning and Instruction Tuning (2024.findings-emnlp)
Copied to clipboard
| Challenge: | In-Context Learning (ICL) and Instruction Tuning (IT) are two primary paradigms of adopting Large Language Models (LLMs) to downstream applications, but they are significantly different. |
| Approach: | They examine how the hidden states of Large Language Models change in these two paradigms by examining how they differ in implementation. |
| Outcome: | The proposed model changes the hidden states of LLMs as if its accompanying demonstrations were used to instructionally tune the model. |
A Pragmatic Approach for Classical Chinese Word Segmentation (L18-1)
Copied to clipboard
| Challenge: | Classical Chinese word segmentation is largely neglected due to its obsoleteness . a new approach to segmentation using a marked-up corpus is needed . |
| Approach: | They propose a pragmatic approach to deal with Classical Chinese word segmentation without any marked-up corpus. |
| Outcome: | The proposed method makes the CCWS without any marked-up corpus more accurate compared with collocation-based methods. |
Relying on the Unreliable: The Impact of Language Models’ Reluctance to Express Uncertainty (2024.acl-long)
Copied to clipboard
| Challenge: | a pivotal aspect of fostering reliable human-AI interactions lies in the apt communication of model confidences. |
| Approach: | They examine how LMs incorporate confidence in responses via natural language . they also examine how downstream users behave in response to LM-articulated uncertainties . |
| Outcome: | The proposed model overconfidences are high in LMs, and humans are biased against uncertainty-rich texts. |
Towards Open-Domain Twitter User Profile Inference (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to user profile inference focus on limited attributes and can reveal users' private information. |
| Approach: | They propose a prompt-based generation method which can infer values implicitly mentioned in Twitter user profiles. |
| Outcome: | The proposed method can infer more comprehensive user profiles than baseline extraction-based methods, but limitations remain to be applied for real-world use. |
Event Causality Extraction with Event Argument Correlations (2022.coling-1)
Copied to clipboard
| Challenge: | Event Causality Identification (ECI) ignores crucial event structure and cause-effect component information, making it struggle for downstream applications. |
| Approach: | They propose a task to extract event causality pairs with their structured event information from plain text. |
| Outcome: | The proposed method captures the intra- and inter-event argument correlations for ECE and provides several future directions. |
EA2E: Improving Consistency with Event Awareness for Document-Level Argument Extraction (2022.findings-naacl)
Copied to clipboard
| Challenge: | Recent work on document-level event argument extraction models each individual event in isolation and therefore causes inconsistency among extracted arguments across events. |
| Approach: | They propose an event-aware argument extraction model with augmented context to improve consistency . they hypothesize that participants tend to play consistent roles across multiple events in a document . |
| Outcome: | The proposed model improves consistency and accuracy of arguments extracted from documents. |
Bridging the Gap Between BabelNet and HowNet: Unsupervised Sense Alignment and Sememe Prediction (2023.eacl-main)
Copied to clipboard
| Challenge: | Sememes are the minimum semantic units of natural languages, but their use is limited by a lack of available sememe knowledge bases. |
| Approach: | They propose to use sense alignment to connect BabelNet with HowNet by relaxing constraints until a complete alignment is achieved. |
| Outcome: | The proposed method improves on previous supervised methods by 12% . it is based on interpretable propagation of sememe information between lexical resources . |
MA-BERT: Learning Representation by Incorporating Multi-Attribute Knowledge in Transformers (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for incorporating external attribute knowledge into deep neural networks are concatenating multiple attributes to word/text representation or treating them as biases to adjust attention distribution. |
| Approach: | They propose a multi-attribute BERT to incorporate external attribute knowledge into deep neural networks. |
| Outcome: | The proposed method outperforms existing models and models on three benchmark datasets. |
SPECTER: Document-level Representation Learning using Citation-informed Transformers (2020.acl-main)
Copied to clipboard
| Challenge: | Recent Transformer language models do not leverage information on inter-document relatedness, which limits their document-level representation power. |
| Approach: | They propose a method to generate document-level embeddings using citation graphs. |
| Outcome: | The proposed method outperforms baselines on document-level tasks. |
A Learning-Exploring Method to Generate Diverse Paraphrases with Multi-Objective Deep Reinforcement Learning (2020.coling-main)
Copied to clipboard
| Challenge: | Paraphrase generation is of great importance for many downstream tasks in natural language processing. |
| Approach: | They propose a method to generate sentences as learning objectives from the learned data distribution and employ reinforcement learning to combine these new learning objectives for model training. |
| Outcome: | The proposed method gains significant diversity and improves generation quality over state-of-the-art datasets. |
Predicate-Conditional Conformalized Answer Sets for Knowledge Graph Embeddings (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods provide probabilistic guarantees over a reference set of queries and answers, but they fail to identify when the answers to a query are uncertain. |
| Approach: | They propose a method that approximates predicate-conditional coverage guarantees while maintaining compact prediction sets. |
| Outcome: | The proposed method provides predicate-conditional coverage guarantees while maintaining compact prediction sets. |
A Neural Transition-based Joint Model for Disease Named Entity Recognition and Normalization (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models for disease recognition and normalization ignore text surface form of each candidate concept, causing boundary inconsistency. |
| Approach: | They propose a neural transition-based joint model to normalize disease entities from biomedical text. |
| Outcome: | The proposed model improves on two publicly available datasets. |
OneAligner: Zero-shot Cross-lingual Transfer with One Rich-Resource Language Pair for Low-Resource Sentence Retrieval (2022.findings-acl)
Copied to clipboard
| Challenge: | a new model for parallel sentence retrieval can be used to align parallel sentences in multilingual corpora . a faithful aligner can help narrow down the candidate pool without having to deal with an enormous search space . |
| Approach: | They propose a model that can be trained on only one language pair and transfers to low-resource languages with negligible degradation in performance. |
| Outcome: | The proposed model outperforms the previous model on the Tateoba dataset by 8.0 points in accuracy and using less than 0.6% of their parallel data. |
KGE-CL: Contrastive Learning of Tensor Decomposition Based Knowledge Graph Embeddings (2022.coling-1)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods ignore semantic similarity between related entities and entity-relation couples in different triples . |
| Approach: | They propose a contrastive learning framework for tensor decomposition based (TDB) KGE that can shorten the semantic distance of related entities and entity-relation couples in different triples and thus improve the performance of KGE. |
| Outcome: | The proposed method achieves 51.2% MRR, 46.8% Hits@1 on three standard KGE datasets, 37.8% MRR and 28.6% Hits @1 on FB15k-237 datasets and 59.1% MRR . |
Closed-book Question Generation via Contrastive Learning (2023.eacl-main)
Copied to clipboard
| Challenge: | Recent studies on open-book QG have achieved promising progress, but generating natural questions under a more practical closed-book setting remains a challenge. |
| Approach: | They propose a QG model that stores more information in its parameters through contrastive learning and an answer reconstruction module. |
| Outcome: | The proposed model outperforms baselines in automatic evaluation and human evaluation on a public dataset and a new WikiCQA dataset. |
Causal-Debias: Unifying Debiasing in Pretrained Language Models and Fine-tuning via Causal Invariant Learning (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods to remove unwanted stereotypical associations from pretrained language models (PLMs) are often focused on removing unwanted stereotypes from PLMs. |
| Approach: | They propose a framework to remove unwanted stereotypical associations in pretrained language models . they propose bias-relevant factors are causal, while labelrelevant factors causal . |
| Outcome: | The proposed framework reduces stereotypical associations after PLMs are fine-tuned . the proposed framework mitigates bias from a causal invariant perspective . |
Multi-task Pairwise Neural Ranking for Hashtag Segmentation (P19-1)
Copied to clipboard
| Challenge: | Hashtags are used to add metadata to textual utterances, but their semantic content is difficult to infer as they often contain multiple tokens joined together. |
| Approach: | They propose to use a dataset of 12,594 hashtags to infer hashtag semantics . they propose to frame the problem as a pairwise ranking problem between candidate segmentations . |
| Outcome: | The proposed methods show 24.6% error reduction in hashtag segmentation accuracy compared to the current state-of-the-art method. |
Sentence-Level Evidence Embedding for Claim Verification with Hierarchical Attention Networks (P19-1)
Copied to clipboard
| Challenge: | Claim verification is cumbersome and inefficient for human fact-checkers to find consistent pieces of evidence. |
| Approach: | They propose an end-to-end hierarchical attention network that learns to represent coherent evidence and their semantic relatedness with the claim. |
| Outcome: | The proposed model outperforms state-of-the-art models on three datasets . it is based on a coherence-based attention layer and entailment-based one . |
A Comprehensive Study of Gender Bias in Chemical Named Entity Recognition Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Chemical named entity recognition (NER) models are used in many downstream tasks, but it is unknown whether they work the same for everyone. |
| Approach: | They develop a framework for measuring gender bias in chemical NER models . they analyze a corpus of 92,405 words with self-identified gender information from reddit . |
| Outcome: | The proposed framework measures gender bias in chemical NER models using synthetic data and a newly annotated corpus of over 92,405 words with self-identified gender information from Reddit. |
BSCodec: A Band-Split Neural Codec for High-Quality Universal Audio Reconstruction (2026.findings-eacl)
Copied to clipboard
| Challenge: | Neural audio codecs have enabled high-fidelity reconstruction of speech, music and sound . however, speech-optimized codec systems suffer degradation on music or sound if they ignore spectral differences . |
| Approach: | They propose a neural audio codec that splits the spectral dimension into separate bands and compresses each band independently. |
| Outcome: | Experimental results show that BSCodec achieves better reconstruction quality on music and sound compared to existing codecs. |
Doc-GCN: Heterogeneous Graph Convolutional Networks for Document Layout Analysis (2022.coling-1)
Copied to clipboard
| Challenge: | Document Layout Analysis tasks rely on visual cues to understand documents . traditional deep learning-based methods fail to recognize the layout and components of unstructured documents based on the document structure and the boundaries of each layout region. |
| Approach: | They propose a way to harmonize and integrate heterogeneous aspects for Document Layout Analysis by using graph convolutional networks to enhance each aspect of features. |
| Outcome: | The proposed task is based on three widely used datasets: PubLayNet, FUNSD, and DocBank. |
Semantics as a Foreign Language (D18-1)
Copied to clipboard
| Challenge: | (2017): Syntactic grammars capture propositions, but graph-based representations aim to capture a wider notion of propositions. |
| Approach: | They propose a neural sequence-to-sequence framework which can recover syntactic linearizations by a sequence-based approach. |
| Outcome: | The proposed framework performs almost on-par with previous state-of-the-art approaches while requiring less parallel training annotations. |
ExStrucTiny: A Benchmark for Schema-Variable Structured Information Extraction from Document Images (2026.eacl-long)
Copied to clipboard
Mathieu Sibue, Andrés Muñoz Garza, Samuel Mensah, Pranav Shetty, Zhiqiang Ma, Xiaomo Liu, Manuela Veloso
| Challenge: | Existing models for structured information extraction are limited by narrow entity ontologies, simple queries, or homogeneous document types. |
| Approach: | They propose a benchmark dataset for structured Information Extraction (IE) from document images . they analyze open and closed VLMs on this benchmark . |
| Outcome: | The proposed model can perform fine-grained structured extraction across document types and schemas. |
Categorizing and Inferring the Relationship between the Text and Image of Twitter Posts (P19-1)
Copied to clipboard
| Challenge: | Social media posts often contain images to provide content, provide context, or express feelings. |
| Approach: | They build and release a dataset of image tweets annotated with four different classes which express whether the text or the image provides additional information to the other modality. |
| Outcome: | The proposed method can be used in several downstream applications including pre-training image tagging models and collecting distantly supervised data for image captioning. |
Multi-step Jailbreaking Privacy Attacks on ChatGPT (2023.findings-emnlp)
Copied to clipboard
| Challenge: | With the rapid evolution of large language models (LLMs), many downstream NLP tasks can be well solved given appropriate prompts. |
| Approach: | They propose to integrate ChatGPT and Bing GPT3 into their applications to create a set of LLMs that can be used to generate NLP tasks with appropriate prompts. |
| Outcome: | The proposed models can be zero-shot or few-shot learners to solve specified tasks and can even be zero or few shot learners. |
Event Coreference Resolution with their Paraphrases and Argument-aware Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for event coreference resolution do not identify paraphrase relations between events. |
| Approach: | They propose a new event-specific paraphrase and argument-aware semantic Embedding model for event coreference resolution based on event-related paraphrases and argument embeddings . EPASE recognizes deep paraphrase relations in an event- specific context of sentences and can cover event paraphrase of more situations . |
| Outcome: | Experiments on within- and cross-document event coreference show it is superior compared to existing methods. |
HLDC: Hindi Legal Documents Corpus (2022.findings-acl)
Copied to clipboard
Arnav Kapoor, Mudit Dhawan, Anmol Goel, Arjun T H, Akshala Bhatnagar, Vibhu Agrawal, Amul Agrawal, Arnab Bhattacharya, Ponnurangam Kumaraguru, Ashutosh Modi
| Challenge: | Existing systems that process legal documents are lacking high-quality corpora in low resource languages such as Hindi. |
| Approach: | They propose a Hindi Legal Documents Corpus (HLDC) that contains 900K legal documents in Hindi. |
| Outcome: | The proposed model is based on a corpus of more than 900K legal documents in Hindi. |
Crafting Personalized Agents through Retrieval-Augmented Generation on Editable Memory Graphs (2024.emnlp-main)
Copied to clipboard
| Challenge: | In the age of mobile internet, personal information is constantly being generated on smartphones. |
| Approach: | They propose a novel task of crafting personalized agents powered by large language models that leverage a user's smartphone memories to enhance downstream applications with LLM capabilities. |
| Outcome: | The proposed approach improves 10% over the best existing approach on a real-world dataset and improves usability. |
Towards Controllable Biases in Language Generation (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a new method to induce societal biases in natural language generation is being developed . a method to equalize the amount of biased text across demographics is effective . |
| Approach: | They propose a method to induce societal biases in natural language generation by using demographic inequalities. |
| Outcome: | The proposed method is effective at equalizing biases across demographics while generating less negatively biased text overall. |
Dial-In LLM: Human-Aligned LLM-in-the-loop Intent Clustering for Customer Service Dialogues (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing intent clustering methods rely on embedding distance metrics and neglect of underlying semantic structures. |
| Approach: | They propose an LLM-in-the-loop framework that integrates language understanding capabilities into conventional clustering algorithms. |
| Outcome: | The proposed framework outperforms baselines in Chinese and improves quality, cost efficiency and downstream applications. |
BenchIE: A Framework for Multi-Faceted Fact-Based Open Information Extraction Evaluation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks for OIE are incomplete and do not include all acceptable variants of the same fact. |
| Approach: | They introduce BenchIE: a benchmark and evaluation framework for comprehensive evaluation of OIE systems for English, Chinese, and German. |
| Outcome: | The proposed framework is based on fact synsets, clusters, and standardized benchmarks. |
Rethinking Coherence Modeling: Synthetic vs. Downstream Tasks (2021.eacl-main)
Copied to clipboard
| Challenge: | Coherence models are typically evaluated only on synthetic tasks, which may not be representative of their performance in downstream applications. |
| Approach: | They compare models' performance on synthetic sentences with those on retrieval-based dialog. |
| Outcome: | The proposed models perform poorly on synthetic sentences and retrieval-based dialog tasks. |
On the Robustness of Language Encoders against Grammatical Errors (2020.acl-main)
Copied to clipboard
| Challenge: | Pre-trained language encoders are effective in facilitating downstream natural language processing tasks, but they often assume training and test corpora are clean and it is unclear how the models behave when confronted with noisy input. |
| Approach: | They conduct adversarial attacks to simulate grammatical errors on clean text data. |
| Outcome: | The proposed model performs better when confronted with natural grammatical errors than when faced with noisy input. |
Exploring Diverse Expressions for Paraphrase Generation (D19-1)
Copied to clipboard
| Challenge: | Existing neural paraphrase generation methods focus on single paraphrases while ignoring the fact that diversity is essential for enhancing generalization capability and robustness of downstream applications. |
| Approach: | They propose a novel approach with two discriminators and multiple generators to generate a variety of different paraphrases. |
| Outcome: | The proposed model gains significant diversity and improves quality over state-of-the-art datasets. |
Identifying Aspects in Peer Reviews (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to peer review are limited in how they identify aspects . a growing volume of peer review submissions is straining the process . |
| Approach: | They propose a data-driven schema for deriving aspects from peer reviews . they propose augmented peer reviews and show how it can be used for community-level review analysis. |
| Outcome: | The proposed approach can be used to support peer review, but lacks formal definition of aspect . it also shows that the choice of aspects can impact downstream applications . |
Transforming Complex Sentences into a Semantic Hierarchy (P19-1)
Copied to clipboard
| Challenge: | Existing approaches for recursively splitting and rephrasing complex English sentences into a semantic hierarchy of simplified sentences are lacking. |
| Approach: | They propose a method for recursively splitting and rephrasing complex English sentences into a semantic hierarchy of simplified sentences. |
| Outcome: | The proposed approach outperforms state-of-the-art approaches in MT and information extraction tasks. |
ViPE: Visualise Pretty-much Everything (2023.emnlp-main)
Copied to clipboard
| Challenge: | Figure and non-literal expressions are deeply integrated in human communication . text-to-image models like Stable Diffusion struggle to depict non-figural expression . |
| Approach: | They propose a series of lightweight and robust language models that can be used to visualise non-literal expressions. |
| Outcome: | The proposed language models are more robust than existing models and can generate high-quality images. |
Unleashing the Power of Neural Discourse Parsers - A Context and Structure Aware Approach Using Large Scale Pretraining (2020.coling-main)
Copied to clipboard
| Challenge: | Discourse parsing is an important upstream task within the area of Natural Language Processing (NLP) . |
| Approach: | They propose a discourse parser that incorporates recent contextual language models to improve the performance of RST-based discourse parses. |
| Outcome: | The proposed parser outperforms existing models on two key RST datasets and on large-scale "silver-standard" discourse treebank MEGA-DT. |
SEEK: Segmented Embedding of Knowledge Graphs (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods for knowledge graph embedding can not make a proper trade-off between the model complexity and the model expressiveness, which makes them far from satisfactory. |
| Approach: | They propose a lightweight modeling framework that can achieve highly competitive relational expressiveness without increasing the model complexity. |
| Outcome: | The proposed framework can achieve highly competitive relational expressiveness without increasing model complexity. |
Employing Argumentation Knowledge Graphs for Neural Argument Generation (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for generating arguments use end-to-end knowledge graphs or are controlled with respect to the argument's topic, aspects, or stance. |
| Approach: | They construct and populate three knowledge graphs and encode them into debate portals and relevant paragraphs from Wikipedia. |
| Outcome: | The proposed model produces arguments with superior quality than those generated without knowledge. |
Marked Attribute Bias in Natural Language Inference (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing tests for gender-biased word embeddings do not address marked attribute bias . authors propose a new type of intrinsic bias measure for static word embeds . |
| Approach: | They propose a method to detect gender-biased word embeddings in a downstream NLP application . they propose 'debiasing' method to measure the marked attribute bias in embeddable word embeds . |
| Outcome: | The proposed method achieves best results on the marked attribute bias test set. |
Abstractive Open Information Extraction (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing OpenIE datasets and metrics are ill-suited for this task. |
| Approach: | They propose a new open-domain task that extends OpenIE to include inferred relations . they propose metric to evaluate the effectiveness of open-source OpenIE . |
| Outcome: | The proposed model can extract inferred relations from the extracted relation tuples. |
Is “My Favorite New Movie” My Favorite Movie? Probing the Understanding of Recursive Noun Phrases (2022.naacl-main)
Copied to clipboard
| Challenge: | Recursive noun phrases have interesting semantic properties, yet it is unknown whether language models have such knowledge. |
| Approach: | They propose a dataset of three textual inference tasks targeting recursive noun phrases . they show that such knowledge is learnable with appropriate data . |
| Outcome: | The proposed model achieves strong zero-shot performance on an extrinsic Harm Detection task. |
Co2PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained language models can encode unfair social biases from large pre-training corpora and even amplify biase in downstream applications. |
| Approach: | They propose a *debias-while-prompt tuning* method for mitigating biases via counterfactual contrastive prompt tuning on downstream tasks. |
| Outcome: | The proposed method can mitigate biases on three extrinsic bias benchmarks and adapt to existing debiased language models. |
Compressing Context to Enhance Inference Efficiency of Large Language Models (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable power and impressive generalisation abilities across various tasks. |
| Approach: | They propose a method that prunes redundancies in the input context to make the input more compact. |
| Outcome: | The proposed method reduces memory and inference time while maintaining comparable performance compared to full context. |
Zero-Shot Dialogue Disentanglement by Self-Supervised Entangled Response Selection (2021.emnlp-main)
Copied to clipboard
| Challenge: | a zero-shot dialogue disentanglement solution is difficult due to the need for manual annotation. |
| Approach: | They propose a zero-shot dialogue disentanglement solution using a web dataset . they train a model on the data and fine-tune the model using labeled data . |
| Outcome: | The proposed model achieves a cluster F1 score of 25 without labeling data . it can be used to analyze discourses and to perform response selection . |
Revisiting the Evaluation of End-to-end Event Extraction (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing EE research uses the role-averaged evaluation metric, but it is misleading to downstream applications. |
| Approach: | They propose two new evaluation metrics that explicitly penalize wrongly identified event arguments. |
| Outcome: | The proposed evaluation metrics improve the initial evaluation by 10% . the proposed training scheme is better than the existing one, the authors show . |
When do Word Embeddings Accurately Reflect Surveys on our Beliefs About People? (2020.acl-main)
Copied to clipboard
| Challenge: | a study of word embeddings shows that social biases are more accurate than survey data for some dimensions of meaning. |
| Approach: | a new study investigates the extent to which word embeddings accurately reflect biases . they find that biased word embeds mirror survey data across 17 dimensions of social meaning . |
| Outcome: | a new study shows that word embeddings accurately reflect biases on average across dimensions of social meaning . biased embedders are more reflective of survey data for some dimensions of meaning than others, the study finds . |
Matching Pairs: Attributing Fine-Tuned Models to their Pre-Trained Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | generative large language models (LLMs) are widely used but fine-tuned to improve performance on downstream applications leads to violations of model licenses, model theft, and copyright infringement. |
| Approach: | They propose to trace back the origin of a model trained to its pre-trained base model . they use different knowledge levels and attribution strategies to find out how the model was trained . |
| Outcome: | The proposed method can trace back 8 out of 10 fine tuned models with different knowledge levels and attribution strategies. |
Emergent Communication Pretraining for Few-Shot Machine Translation (2020.coling-main)
Copied to clipboard
| Challenge: | state-of-the-art models that rely on multilingual pretrained encoders achieve sample efficiency in downstream applications, but lack abundant amounts of unlabelled text. |
| Approach: | They propose a method to pretrain neural networks via emergent communication from referential games by grounding communication on images as a crude approximation of real-world environments. |
| Outcome: | The proposed method significantly improves machine translation in few-shot settings and provides an evaluation protocol to probe the properties of emergent languages ex vitro. |
GroundCocoa: A Benchmark for Evaluating Compositional & Conditional Reasoning in Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing LLMs excel and often surpass human performance on benchmarks, but they are known to falter in simple tasks and under seemingly straightforward circumstances. |
| Approach: | They propose a benchmark to assess compositional and conditional reasoning within a flight booking task. |
| Outcome: | The proposed model outperforms existing models on the flight booking task with a 67% accuracy rate. |
Acquired TASTE: Multimodal Stance Detection with Textual and Structural Embeddings (2025.coling-main)
Copied to clipboard
| Challenge: | Prior work has demonstrated the importance of the conversational context in stance detection. |
| Approach: | They propose a multimodal architecture for stance detection that fuses transformer-based content embedding with unsupervised structural embeddment. |
| Outcome: | The proposed model outperforms strong baselines on common benchmarks and outperformed existing models on common frameworks. |
Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on multilingual sentence embeddings focus on cross-lingual semantic textual similarity and transfer tasks. |
| Approach: | They propose a method to improve existing multilingual sentence embeddings with Abstract Meaning Representation (AMR) . they compare existing multi-lingual sentence embedded with AMR and improve their versions by reducing the surface variations across different languages and expressions. |
| Outcome: | The proposed method improves state-of-the-art multilingual sentence embeddings on transfer tasks and semantic textual similarity tests. |
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples (2025.naacl-long)
Copied to clipboard
Ajay Patel, Jiacheng Zhu, Justin Qiu, Zachary Horvitz, Marianna Apidianaki, Kathleen McKeown, Chris Callison-Burch
| Challenge: | Existing methods for embedding text are limited by the imperfect nature of data acquired under such assumptions. |
| Approach: | They propose a new approach to training stronger content-independent style embeddings using a synthetic dataset of near-exact paraphrases with controlled style variations. |
| Outcome: | The proposed model outperforms existing methods in real-world benchmarks and outperformed leading style representations in downstream applications. |
Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models (2022.coling-1)
Copied to clipboard
| Challenge: | Prompting has shown to be sample efficient compared to fine-tuning with pre-trained models. |
| Approach: | They propose a fully automatic prompting method that uses natural language prompts on sequence-to-sequence models and a beam search method to generate a large amount of label sequence candidates. |
| Outcome: | The proposed method significantly outperforms other no-manual-design methods on single label words and generates large amount of label sequence candidates. |
RtGender: A Corpus for Studying Differential Responses to Gender (L18-1)
Copied to clipboard
| Challenge: | Prior work on linguistic gender difference and communications about gender has focused on language about or portraying persons of a particular gender. |
| Approach: | They present a multi-genre corpus of 25M comments from five socially and topically diverse sources tagged for the gender of the addressee and 30k annotations for sentiment and relevance of these responses. |
| Outcome: | The proposed dataset shows that responses to women are more emotive and about the speaker as an individual (rather than about the content being responded to). |
Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence (2025.acl-long)
Copied to clipboard
| Challenge: | Notably, when multiple biases combine, models exhibit catastrophic performance degradation, selecting the answer-containing document in less than 10% of cases over a synthetic biased document without the answer. |
| Approach: | They repurpose a relation extraction dataset to quantify the impact of heuristic biases on retrievers like Dragon+ and Contriever. |
| Outcome: | The proposed models exhibit catastrophic performance degradation when multiple biases combine, selecting the answer-containing document in less than 10% of cases over a synthetic biased document without the answer. |
A Mixture-of-Experts Model for Learning Multi-Facet Entity Embeddings (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for learning entity embeddings from text descriptions leave it to downstream applications to identify these different facets and to select the most relevant ones. |
| Approach: | They propose a model that instead learns several vectors for each entity, each of which captures a different aspect of the considered domain. |
| Outcome: | The proposed model learns several vectors for each entity, each of which intuitively captures a different aspect of the considered domain. |
On Reference (In-)Determinacy in Natural Language Inference (2025.findings-naacl)
Copied to clipboard
Sihao Chen, Chaitanya Malaviya, Alex Fabrikant, Hagai Taitelbaum, Tal Schuster, Senaka Buthpitiya, Dan Roth
| Challenge: | Using reference determinacy, models fail to recognize context mismatch in NLI examples . |
| Approach: | They propose a benchmark to identify reference ambiguity in NLI examples . they propose RD as a possible assumption for natural language inference . |
| Outcome: | The proposed benchmark identifies reference ambiguity in natural language inference examples . 80% false contradiction and >50% entailment predictions are found . |
Content- and Topology-Aware Representation Learning for Scientific Multi-Literature (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches focus on learning textual information at sentence- or document-level, but ignore inter-document connections. |
| Approach: | They propose a model that extends representation learning to the multi-document level . it integrates latent semantic and rich relatedness information from topological networks . |
| Outcome: | The proposed model learns latent semantic information from content and rich relatedness information from topological networks. |
Why Swear? Analyzing and Inferring the Intentions of Vulgar Expressions (D18-1)
Copied to clipboard
| Challenge: | Vulgar words are employed in language use for several different functions, including expressing aggression, signaling group identity or the informality of the communication. |
| Approach: | They present a dataset of 7,800 tweets with six categories of vulgarity in which all instances of vulgar words are annotated with one of the six categories. |
| Outcome: | The proposed model can predict the category of a vulgar word based on the immediate context it appears in with 67.4 macro F1 across six classes. |
Classification-based Quality Estimation: Small and Efficient Models for Real-world Applications (2021.emnlp-main)
Copied to clipboard
| Challenge: | Sentence-level Quality estimation (QE) is traditionally a regression task . but large multilingual contextualized language models are expensive and infeasible for real-world applications. |
| Approach: | They evaluate several model compression techniques for QE and find they are inefficient . they argue that a full model parameterization is required to achieve SoTA results . |
| Outcome: | The proposed models are poorly expressive in a regression task, the authors argue . they show that reframing QE as a classification problem and evaluating models would improve their performance in real-world applications. |
Dual Complex Number Knowledge Graph Embeddings (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing knowledge graph embedding methods fail to model non-commutative composition patterns . extending to such sophisticated spaces increases the amount of parameters, which greatly reduces the parameter efficiency. |
| Approach: | They propose a new knowledge graph embedding method that maps entities to the dual complex number space and represents relations as rotations in 2D space via dual complex multiplication. |
| Outcome: | Experiments on multiple benchmark knowledge graphs show that the proposed method improves link prediction and path query answering. |
SENT: Sentence-level Distant Relation Extraction via Negative Training (2021.acl-long)
Copied to clipboard
| Challenge: | Existing methods for relation extraction use bag labels, which introduce noise, to train the model. |
| Approach: | They propose to use negative training to train a model using complementary labels to separate the noisy data from the training data. |
| Outcome: | The proposed method improves on previous methods on sentence-level evaluation and de-noise effect. |
MetaKP: On-Demand Keyphrase Generation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing keyphrase prediction methods only output a single set of keyphrases per document . however, existing methods fail to cater to diverse needs of users and downstream applications . |
| Approach: | They propose a method that requires keyphrases that conform to specific high-level goals or intents to generate on-demand keyphrase generation. |
| Outcome: | The proposed method surpasses the performance of a fully fine-tuned BART-base model in 0.548 SemF1 . it can be used in epidemic event detection from social media. |
CONSISTENT: Open-Ended Question Generation From News Articles (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work on question generation has largely focused on factoid questions such as who, what, where, when about basic facts. |
| Approach: | They propose an end-to-end system for generating openended questions that are answerable from and faithful to the input text. |
| Outcome: | The proposed model outperforms existing models and can be used in news media organizations. |
Neural semi-Markov CRF for Monolingual Word Alignment (2021.acl-long)
Copied to clipboard
| Challenge: | Experimental results show that our proposed model outperforms all previous approaches for monolingual word alignment. |
| Approach: | They propose a neural semi-Markov CRF alignment model which unifies word and phrase alignments through variable-length spans. |
| Outcome: | The proposed model outperforms existing models on in-domain and out-of-domain evaluations and a QA-based benchmark with human annotations. |
NeuInfer: Knowledge Inference on N-ary Facts (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on knowledge inference on binary facts have focused on finding out connotative valid facts. |
| Approach: | They propose a neural network model, NeuInfer, for knowledge inference on n-ary facts. |
| Outcome: | The proposed model can cope with the task to infer an unknown element in a whole fact, while ignoring the binary facts. |
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning (2024.findings-acl)
Copied to clipboard
| Challenge: | Parameter-Efficient Fine-Tuning (PEFT) methods allow efficient adaptation of Large Language Models (LLMs) to various downstream tasks, but their effectiveness diminishes when downstream tasks require accurate learning of specific knowledge. |
| Approach: | They propose a method that fine-tunes a limited number of model parameters while keeping the majority of original parameters fixed. |
| Outcome: | The proposed method is able to perform on open-source large language models and validates the semantic challenge in PEFT. |
Evaluating Unsupervised Dimensionality Reduction Methods for Pretrained Sentence Embeddings (2024.lrec-main)
Copied to clipboard
| Challenge: | Sentence embeddings produced by pretrained language models are high dimensional (ca. 1024-4096) this is problematic when representing large numbers of sentences in memory- or compute-constrained devices. |
| Approach: | They propose to use Principal Component Analysis to reduce the dimensionality of sentence embeddings produced by pretrained language models to reduce their complexity. |
| Outcome: | The proposed methods reduce the dimensionality of sentence embeddings by 50% without incurring significant loss in performance in multiple downstream tasks. |
KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completion (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing knowledge graph completion methods struggle with long-tail entities due to limited structural information and imbalanced distributions of entities. |
| Approach: | They propose a framework that integrates a large language model and a triple-based KGC retriever to alleviate the long-tail problem without incurring additional training overhead. |
| Outcome: | The proposed model reduces training overhead and finetuning costs on benchmark datasets. |
Beyond Cross-Modal Alignment: Measuring and Leveraging Modality Gap in Vision-Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | a recent study shows that vision-language models have modality gaps that persist even in well-aligned models. |
| Approach: | They propose a modality-dominance score to measure and leverage modality gaps . they propose automatic interpretability metrics to evaluate these features in a scalable manner . |
| Outcome: | The proposed framework allows for training-free probing and editing methods for understanding model perception across genders and generating adversarial examples. |
Measuring Political Bias in Large Language Models: What Is Said and How It Is Said (2024.acl-long)
Copied to clipboard
| Challenge: | Existing benchmarks and measures focus on gender and racial biases, but political bias exists in LLMs and can lead to polarization and other harms in downstream applications. |
| Approach: | They propose to analyze the content and style of LLMs generated by political issues and propose a framework that can be scalable to other topics. |
| Outcome: | The proposed framework is easily scalable to other topics and is explainable. |
LogiCoL: Logically-Informed Contrastive Learning for Set-based Dense Retrieval (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current dense retrievers struggle with queries with logical connectives, a use case that is often overlooked but important in downstream applications. |
| Approach: | They propose a logically-informed contrastive learning objective for dense retrievers that learns to respect the subset and mutually exclusive set relation between query results. |
| Outcome: | The proposed model improves retrieval performance and consistency on entity retrieval tasks. |
FeedEval: Pedagogically Aligned Evaluation of LLM-Generated Essay Feedback (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent research emphasizes the generation of high-quality feedback that provides justification and actionable guidance. |
| Approach: | They propose an LLM-based framework for evaluating LLM feedback along three dimensions: specificity, helpfulness, and validity. |
| Outcome: | The proposed framework evaluates LLM-generated feedback along three dimensions: specificity, helpfulness, and validity. |
Making Pre-trained Language Models both Task-solvers and Self-calibrators (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work shows that pre-trained language models can be effective for high-stake applications, but they become overconfident in their wrong predictions. |
| Approach: | They propose to use extra data to train pre-trained language models to effectively utilize training samples to make them both task-solvers and self-calibrators. |
| Outcome: | The proposed method can be used in three downstream applications, including selective classification, adversarial defense, and model cascading. |
Attribution and Application of Multiple Neurons in Multimodal Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to identify multimodal neurons in MLLMs are insufficiently understood . previous studies focused on identifying neurons corresponding to single-tokens . |
| Approach: | They propose a method to identify multimodal neurons in Transformer-based MLLMs . they introduce fuzzy set theory to model the complex relationship between neurons and semantic concepts . |
| Outcome: | The proposed method improves performance on the Visual Question Answering task. |
CAPE: Context-Aware Private Embeddings for Private Language Learning (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to obtain text representations or embeddings with these models encoding personally identifiable information may lead to privacy leaks. |
| Approach: | They propose a novel approach which combines differential privacy and adversarial learning to preserve privacy during training of embeddings. |
| Outcome: | The proposed approach reduces private information leakage by 3% over the current method. |
Data to Defense: The Role of Curation in Aligning Large Language Models Against Safety Compromise (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies have identified a vulnerability in large language models (LLMs) during customization. |
| Approach: | They propose an adaptive data curation approach that allows any text to be curated to enhance its effectiveness in counteracting harmful samples during customization. |
| Outcome: | The proposed approach reduces compromising effects and generates 100% safe responses. |
Evaluating and Improving Factuality in Multimodal Abstractive Summarization (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current factuality metrics do not account for vision modality, thus are not adequate for vision-and-language summarization. |
| Approach: | They propose a weighted combination of CLIPScore and BERTScore to evaluate factuality for abstractive document summarization. |
| Outcome: | The proposed metric outperforms existing factuality metrics on four factuity metric-evaluation benchmarks and is robust to human judgments. |
wav2vec-S: Adapting Pre-trained Speech Models for Streaming (2024.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained speech models have advanced speech-related tasks, including speech recognition and translation. |
| Approach: | They propose a pre-trained speech model that incorporates modifications to ensure consistent speech representations during training and inference phases for streaming speech inputs. |
| Outcome: | The proposed model outperforms baseline models on speech recognition and translation tasks and achieves a superior balance between quality and latency. |
Towards Efficient Dialogue Pre-training with Transferable and Interpretable Latent Structure (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that use millions of parameters on massive data are inefficient and lack interpretability. |
| Approach: | They propose a model with a latent structure that is easily transferable from the general domain to downstream tasks in a lightweight and transparent way. |
| Outcome: | The proposed model performs better than four strong baseline models in terms of automatic and human evaluations and is 5x faster than the strongest baseline model. |
KGvec2go – Knowledge Graph Embeddings as a Service (2020.lrec-1)
Copied to clipboard
| Challenge: | Currently, we serve pre-trained graph embeddings for four knowledge graphs . KGvec2go is a Web API for accessing and consuming graph embeds based on a knowledge graph . |
| Approach: | They propose a Web API for accessing and consuming graph embeddings in a light-weight fashion in downstream applications. |
| Outcome: | The proposed service can be used in machine learning, document modeling, and recommender systems. |
Article and Comment Frames Shape the Quality of Online Comments (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent work has focused on predicting comment toxicity or quality, but it ignores audience reactions. |
| Approach: | They propose a frame-aware system to mitigate unhealthy discourse . they analysed 1M comments across 2.7K news articles . |
| Outcome: | The proposed system can mitigate unhealthy discourses by analyzing 1M comments across 2.7K news articles. |
Creation of a Balanced State-of-the-Art Multilayer Corpus for NLU (L18-1)
Copied to clipboard
Normunds Gruzitis, Lauma Pretkalnina, Baiba Saulite, Laura Rituma, Gunta Nespore-Berzkalne, Arturs Znotins, Peteris Paikens
| Challenge: | Using full stack of language resources, we are creating a balanced text corpus for Latvian. |
| Approach: | They propose to create a syntactically and semantically annotated multilayered corpus for Latvian . they use widely acknowledged and cross-lingual representations for the corpus . |
| Outcome: | The proposed corpus adopts widely recognized and cross-lingual representations for natural language understanding and generation in Latvian. |
Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models generate text that is problematic or lacks a desired attribute. |
| Approach: | They propose a text generation procedure that uses a small unidirectional reward model to encourage a language model to generate text with certain properties. |
| Outcome: | The proposed procedure outperforms prior weighted decoding methods and matches state-of-the-art techniques that require additional training. |
SciNLP: A Domain-Specific Benchmark for Full-Text Scientific Entity and Relation Extraction in NLP (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets for structured information extraction focus on specific publication sections due to domain complexity and high cost of annotating scientific texts. |
| Approach: | They propose a specialized benchmark for full-text entity and relation extraction in the natural language processing domain. |
| Outcome: | The proposed dataset comprises 60 manually annotated full-text NLP publications covering 7,072 entities and 1,826 relations. |
Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models that target a single language are not seen during finetuning, but are able to respond in multiple languages once deployed in downstream applications. |
| Approach: | They investigate the minimal amount of multilinguality required during finetuning to elicit effective cross-lingual generalisation in English-centric LLMs. |
| Outcome: | The proposed model can respond in as few as two to three languages to a user's query in English, but the degree to which a target language is seen during pretraining is limiting. |
RankCSE: Unsupervised Sentence Representations Learning via Learning to Rank (2023.acl-long)
Copied to clipboard
Jiduan Liu, Jiahao Liu, Qifan Wang, Jingang Wang, Wei Wu, Yunsen Xian, Dongyan Zhao, Kai Chen, Rui Yan
| Challenge: | Unsupervised sentence representation learning is one of the fundamental problems in natural language processing . contrastive learning methods fail to capture fine-grained ranking information among the sentences . |
| Approach: | They propose a novel approach for unsupervised sentence representation learning that integrates ranking consistency and ranking distillation with contrastive learning into a unified framework. |
| Outcome: | The proposed approach performs better over state-of-the-art models on STS and TR tasks. |
MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing pretrained language models for mental health detection are inadequate . one in four people worldwide suffers from mental disorders . |
| Approach: | They train and release two pretrained masked language models to benefit machine learning for mental healthcare research . they demonstrate that language representations pretrained in the target domain improve the performance of mental health detection tasks. |
| Outcome: | The proposed models improve mental health detection tasks on several benchmarks and are available for free. |
BehanceCC: A ChitChat Detection Dataset For Livestreaming Video Transcripts (2022.lrec-1)
Copied to clipboard
| Challenge: | livestreaming videos contain a considerable amount of off-topic content, causing noises and data load to downstream applications. |
| Approach: | They propose a human-annotated benchmark dataset for off-topic detection in livestreaming video transcripts. |
| Outcome: | The proposed dataset reveals the complexity of chitchat detection in livestreaming videos . livestreams tend to be longer than pre-recorded videos and have fewer verbal pauses . |
QUARTZ: QA-based Unsupervised Abstractive Refinement for Task-oriented Dialogue Summarization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a framework for task-oriented utility-based dialogue summarization is proposed . QUARTZ is a tool for task summarizing dialogues, but its outputs lack task-specific focus. |
| Approach: | They propose a framework for task-oriented utility-based dialogue summarization . QUARTZ generates summaries and question-answer pairs from a dialogue in a zero-shot manner . |
| Outcome: | The proposed framework achieves competitive results in zero-shot settings, rivaling fully-supervised State-of-the-Art methods. |
Analyzing Political Bias in LLMs via Target-Oriented Sentiment Classification (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to analyze political biases rely on small-size intermediate tasks and the LLMs themselves. |
| Approach: | They propose an entropy-based inconsistency metric to encode political biases . they insert 1319 demographically and politically diverse politician names in 450 political sentences . |
| Outcome: | The proposed method combines high accuracy with a correct understanding of the candidate candidate. |
Multi-Task Knowledge Distillation with Embedding Constraints for Scholarly Keyphrase Boundary Classification (2023.emnlp-main)
Copied to clipboard
| Challenge: | Scholarly keyphrase boundary classification is the task of identifying highly summative phrases from scientific papers and classifying them into a set of predefined classes. |
| Approach: | They propose a constraint which enforces the teachers and student similarity in the embedding space. |
| Outcome: | The proposed constraint outperforms previous studies and strong baselines on three datasets of scientific documents. |
Applying Intrinsic Debiasing on Downstream Tasks: Challenges and Considerations for Machine Translation (2024.emnlp-main)
Copied to clipboard
| Challenge: | In this study, we examine three considerations for intrinsic debiasing in neural machine translation models. |
| Approach: | They propose to measure the extrinsic bias of neural machine translation models by embedding them in a neural embeddable space and using different tokens to debias them. |
| Outcome: | The proposed methods over-rely on gender stereotypes and over-represent them in their models. |
Decoding Susceptibility: Modeling Misbelief to Misinformation Through a Computational Approach (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies on susceptibility to misinformation rely on self-reported beliefs, which can be subject to bias, expensive to collect, and challenging to scale for downstream applications. |
| Approach: | They propose a computational approach to efficiently model users’ latent susceptibility levels by using demographic factors and political ideology as inputs. |
| Outcome: | The proposed model shows that political leanings and other psychological factors exhibit varying degrees of association with susceptibility to COVID-19 misinformation. |
CompleQA: Benchmarking the Impacts of Knowledge Graph Completion Methods on Question Answering (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies have focused on Knowledge Graph Completion as an end in itself, neglecting its potential impact on subsequent applications. |
| Approach: | They propose a benchmark to assess the impact of representative KGC methods on Knowledge Graph Question Answering (KGQA) they use a knowledge graph with 3 million triplets across 5 distinct domains to evaluate their results. |
| Outcome: | The proposed benchmark compares four well-known methods with two state-of-the-art systems to assess the impact of incomplete knowledge graphs on KGQA. |
Control Large Language Models via Divide and Conquer (2024.emnlp-main)
Copied to clipboard
| Challenge: | Lexically Constrained Generation (LCG) is a crucial task of text generation. |
| Approach: | They propose a Divide and Conquer Generation strategy to enhance LLMs' performance in Lexically Constrained Generation with prompt-based controlling. |
| Outcome: | The proposed strategy shows 90% improvement on the most challenging LCG task. |
A French Corpus for Semantic Similarity (2020.lrec-1)
Copied to clipboard
| Challenge: | Semantic textual similarity is a subtask of Natural Language Processing. |
| Approach: | They propose to use an annotation corpus for French to assess semantic similarity . they use an annotated corpus with 1,010 sentence pairs with five annotators . |
| Outcome: | The proposed corpus for French is the first that we know of. |
Word Sense Linking: Disambiguating Outside the Sandbox (2024.findings-acl)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) systems have performed well on several evaluation benchmarks, but it still struggles to find downstream applications. |
| Approach: | They propose a task where systems have to identify which spans to disambiguate and link them to their most suitable meaning. |
| Outcome: | The proposed task performs above the estimated inter-annotator agreement on a set of words . the proposed system is based on 'transformer-based' architectures and iteratively relaxes the assumptions . |
Leveraging Information Redundancy of Real-World Data through Distant Supervision (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for annotation of health care notes are promising but they are limited due to privacy regulations. |
| Approach: | They propose a text labeling method that leverages the redundancy of temporal information in a data lake to create a large programmatically annotated corpus and train transformer models using distant supervision. |
| Outcome: | The proposed method reduces expert annotation time, a scarce and expensive resource. |
Extrinsic Evaluation of Cultural Competence in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Prior studies have evaluated models’ knowledge of cultural norms, values, and artefacts, without considering how this knowledge manifests in downstream applications. |
| Approach: | They propose to evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in prompts. |
| Outcome: | The outputs of two open-ended question answering and story generation tasks are evaluated when an explicit cue of culture, specifically nationality, is perturbed in the prompts. |
Making Large Language Models Better Data Creators (2023.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have advanced the field of NLP significantly, but deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. |
| Approach: | They propose a unified data creation pipeline that requires only a single formatting example. |
| Outcome: | The proposed pipeline can generate data with a single formatting example. |
Learning Interpretable Style Embeddings via Prompting LLMs (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work has treated the style of a text as separable from the content. |
| Approach: | They use prompting to perform stylometry on a large number of texts to generate a synthetic stylometric dataset. |
| Outcome: | The proposed model trains human-interpretable representations on a large stylometric dataset and a linguistic model for style representation learning. |
Generation with Dynamic Vocabulary (2024.emnlp-main)
Copied to clipboard
| Challenge: | Using static vocabulary, vocabulary is ignored in advanced generation tasks. |
| Approach: | They propose a dynamic vocabulary that can involve arbitrary text spans during generation. |
| Outcome: | The proposed vocabulary can be deployed in a plug-and-play way, thus is attractive for various downstream applications. |
zFLoRA: Zero-Latency Fused Low-Rank Adapters (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly deployed with task-specific adapters catering to multiple downstream applications. |
| Approach: | They propose a low-latency fused low-rank adapter that introduces zero latency overhead on top of the base model. |
| Outcome: | The proposed adapter reduces the inference time of the model by 2.5x . the proposed adapters are tested on 18 different tasks on different platforms . |
InsideOut: Measuring and Mitigating Insider–Outsider Bias in Interview Script Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent research has raised concerns about culture-related fairness issues in LLM-generated content. |
| Approach: | They propose to use 4,000 generation prompts and three evaluation metrics to quantify LLMs' **insider-outsider bias** . |
| Outcome: | The proposed method reduces bias in Llama model by 89.70% and mitigates bias on Qwen by 82.54% on cultural alignment gap metric. |
Explicit Bayesian Inference to Uncover the Latent Themes of Large Language Models (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) have impressive generative capabilities, yet their inner mechanisms remain largely opaque. |
| Approach: | They propose a variational autoencoder-based neural topic model to interpret LLMs generation process through an explicit Bayesian framework by inferring latent topic variables via variational inference. |
| Outcome: | The proposed model outperforms state-of-the-art topic models on intrinsic measures of coherence and diversity on multiple datasets and shows significant gains on classification and summarization tasks. |
One QuantLLM for ALL: Fine-tuning Quantized LLMs Once for Efficient Deployments (2025.acl-long)
Copied to clipboard
| Challenge: | Quantization has shown promise for Large Language Models, but current methods require lengthy training to alleviate quantization loss. |
| Approach: | They propose to decouple weights and incorporate Low-Rank adapters to reduce weight sharing . they validate the approach on LLaMA2 families and Mistral on downstream evaluation . |
| Outcome: | The proposed approach shows high performance while reducing deployment time faced with multiple scenarios. |
Beyond Logits: Aligning Feature Dynamics for Effective Knowledge Distillation (2025.acl-long)
Copied to clipboard
Guoqiang Gong, Jiaxing Wang, Jin Xu, Deping Xiang, Zicheng Zhang, Leqi Shen, Yifeng Zhang, JunhuaShu JunhuaShu, ZhaolongXing ZhaolongXing, Zhen Chen, Pengzhang Liu, Ke Zhang
| Challenge: | Knowledge distillation (KD) compresses large language models into lightweight versions called student models. |
| Approach: | They propose to align the entire feature dynamics between teacher and student models by using two additional loss terms to achieve this. |
| Outcome: | The proposed method matches the entire feature dynamics between teacher and student models rather than just the final states. |
Task Oriented In-Domain Data Augmentation (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for large language models suffer from two major issues: in-domain data are scarce compared with general domain-agnostic data. |
| Approach: | They propose a task-oriented in-domain data augmentation framework that uses in- domain data selection and task-orientated synthetic passage generation to adapt LLMs to two domains: advertisement and math. |
| Outcome: | The proposed framework improves LLM performance by 8% in the advertisement domain and 7.5% in the math domain. |
Does Context Matter? A Prosodic Comparison of English and Spanish in Monolingual and Multilingual Discourse Settings (2025.emnlp-main)
Copied to clipboard
| Challenge: | a large number of studies on prosody in languages have focused on monolingual discourse contexts . a recent study focused on the prosodic features of monolingual speech in multilingual contexts. |
| Approach: | They compare prosody of monolingual English and Spanish in monolingual and multilingual settings . they find that monolingual speech produced in a monolingual context is prosodically different from that produced in multilingual context . |
| Outcome: | The proposed study is the first to incorporate multilingual discourse contexts into the study of native-level monolingual prosody. |
Mirage: A Diagnostic Framework for Evaluating the Realism of Synthetic Contact Center Dialogue Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | capturing the full realism of real agent–customer interactions remains a challenge . privacy constraints and data scarcity limit the availability of real conversations . |
| Approach: | They propose a diagnostic evaluation framework for synthetic dialogue generation . they benchmarked strategies guided by structured supervision on call attributes . |
| Outcome: | The proposed framework outperforms synthetic transcripts on quality assurance tasks . it shows that current generation strategies lack sentiment fidelity, disfluency modeling, behavioral variation and conversational realism . |
Causal Graph based Event Reasoning using Semantic Relation Experts (2025.acl-long)
Copied to clipboard
| Challenge: | Recent advances in event reasoning have limited ability to accurately identify causal connections between events. |
| Approach: | They propose a collaborative approach to generate correct graphs and graphs to assist reasoning . they propose 'a causal chain of events' task that requires a causal link between events . |
| Outcome: | The proposed approach achieves competitive results with state-of-the-art models on forecasting and next event prediction tasks. |
Self-Knowledge Distillation for Knowledge Graph Embedding (2024.lrec-main)
Copied to clipboard
| Challenge: | Knowledge graph embedding (KGE) is an important task for many downstream applications. |
| Approach: | They propose to use self-knowledge distillation to learn a low-dimensional model from a pre-trained high-dimensional one. |
| Outcome: | The proposed model can improve model performance while maintaining lightweight structure. |
A Survey of Link Prediction in N-ary Knowledge Graphs (2025.emnlp-main)
Copied to clipboard
Jiyao Wei, Saiping Guan, Da Li, Zhongni Hou, Miao Su, Yucan Guo, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | N-ary Knowledge Graphs (NKGs) capture n-ary facts containing more than two entities. |
| Approach: | They present the first comprehensive survey of link prediction in NKGs . they provide an overview of the field and analyze their performance and application scenarios . |
| Outcome: | The proposed methods provide an overview of the field and analyze performance and application scenarios. |
FocusLLM: Precise Understanding of Long Context by Dynamic Condensing (2025.acl-long)
Copied to clipboard
Zhenyu Li, Yike Zhang, Tengyu Pan, Yutao Sun, Zhichao Duan, Junjie Fang, Rong Han, Zixuan Wang, Jianyong Wang
| Challenge: | Existing context condensing methods cannot accurately understand the full context, as there is a considerable amount of information loss in the condensed process. |
| Approach: | They propose a framework to extend the fixed context length of any decoder-only LLM by distilling crucial information from long sequences. |
| Outcome: | The proposed framework extends the fixed context length of any decoder-only LLM, allowing it to focus on relevant information from very long sequences. |
WojoodRelations: Arabic Relation Extraction Corpus and Modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on Arabic RE remains limited due to the language’s rich morphology and syntactic complexity, and the lack of large, high-quality datasets. |
| Approach: | They propose to use WojoodRelations to extract relation relationships from Arabic textual data using relation-aware templates and GPT-Joint to perform relation-based retrieval. |
| Outcome: | The proposed method achieves a Cohen’s of 0.92, indicating high reliability, and supervised models achieve 92.89% F1 for RE, while LLMs obtain 72.73% F1 . |
Making Revisions Understandable: A Survey of Edit Intentions, Methods, and Applications (2026.findings-acl)
Copied to clipboard
| Challenge: | Text revision is a core process in document creation, capturing how authors iteratively refine, reorganize, and improve written content. |
| Approach: | They synthesize text revision research through the lens of edit intentions . they review prior work across the revision workflow including corpus construction, edit intention taxonomies, edit intentions, and edit intention identification. |
| Outcome: | The proposed approach synthesizes datasets, taxonomies, identification methods, and applications and highlights key open research directions. |
Can LLM Agents Simulate Multi-Turn Human Behavior? Evidence from Real Online Customer Behavior Data (2026.acl-long)
Copied to clipboard
Yuxuan Lu, Jing Huang, Yan Han, Bingsheng Yao, Sisong Bei, Yaochen Xie, Yisi Sang, Qi He, Dakuo Wang
| Challenge: | Recent research shows that LLM Agents can generate “believable” human behaviors via prompt-only methods, leaving open questions of whether they can accurately generate step-by-step actions in multi-turn interaction tasks. |
| Approach: | They propose to use shopping data to evaluate LLMs' ability to accurately generate step-by-step actions in a multi-turn interaction task. |
| Outcome: | The proposed model achieves 17.26% action generation accuracy and 33.86% F1 score on final purchase prediction, representing improvements of 5.4% and 13.85% over baselines. |
Mind the Pause: Disfluency-Aware Objective Tuning for Multilingual Speech Correction with LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Spontaneous speech is rarely fluent, and disfluencies can degrade readability and reliability . a sequence tagger first marks disfluent tokens, and these signals guide instruction fine-tuning . |
| Approach: | They propose a multilingual correction pipeline where a sequence tagger first marks disfluent tokens . they add a contrastive learning objective that penalizes the reproduction of disfluency tokens. |
| Outcome: | The proposed model improves readability and reliability of ASR transcripts in three languages . disfluencies can cause misinterpretations, incoherent responses, poor user experience . |
Apertus: Democratizing Open and Compliant LLMs for Global Language Environments (2026.acl-long)
Copied to clipboard
Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, Angelika Romanou, Antoni-Joan Solergibert, Barna Pásztor, Bettina Messmer, Dhia Garbaya, Eduard Frank Ďurech, Ido Hakimi, Juan Garcia Giraldo, Mete Ismayilzada, Negar Foroutan, Skander Moalla, Tiancheng Chen, Vinko Sabolčec, Yixuan Xu, Michael Aerni, Badr AlKhamissi, Inés Altemir Marinas, Mohammad Hossein Amani, Matin Ansaripour, Ilia Badanin, Harold Benoit, Emanuela Boros, Nicholas John Browning, Fabian Bösch, Maximilian Böther, Niklas Canova, Camille Challier, Clément Charmillot, Jonathan Coles, Jan Milan Deriu, Arnout Devos, Lukas Drescher, Daniil Dzenhaliou, Maud Ehrmann, Dongyang Fan, Simin Fan, Silin Gao, Miguel Gila, María Grandury, Diba Hashemi, Alexander Miserlis Hoyle, Jiaming Jiang, Mark Klein, Andrei Kucharavy, Anastasiia Kucherenko, Frederike Lübeck, Roman Machacek, Theofilos Ioannis Manitaras, Andreas Marfurt, Kyle Matoba, Simon Matrenok, Henrique Mendonça, Fawzi Roberto Mohamed, Syrielle Montariol, Luca Mouchel, Sven Najem-Meyer, Jingwei Ni, Gennaro Oliva, Matteo Pagliardini, Elia Palme, Andrei Panferov, Léo Paoletti, Marco Passerini, Ivan Pavlov, Auguste Poiroux, Kaustubh Ponkshe, Nathan Ranchin, Javier Rando, Mathieu Sauser, Jakhongir Saydaliev, Mukhammadali Sayfiddinov, Marian Schneider, Stefano Schuppli, Marco Scialanga, Andrei Semenov, Kumar Shridhar, Raghav Singhal, Anna Sotnikova, Alexander Sternfeld, Ayush Kumar Tarun, Paul Teiletche, Jannis Vamvas, Xiaozhe Yao, Hao Zhao, Alexander Ilic, Ana Klimovic, Andreas Krause, Caglar Gulcehre, David Rosenthal, Elliott Ash, Florian Tramèr, Joost VandeVondele, Livio Veraldi, Martin Rajman, Thomas C. Schulthess, Torsten Hoefler, Antoine Bosselut, Martin Jaggi, Imanol Schlag
| Challenge: | Apertus is a fully open suite of large language models (LLMs) designed to address responsibility shortcomings in today’s open model ecosystem, namely data responsibility and global representation. |
| Approach: | They propose to release a fully open suite of large language models (LLMs) that address data responsibility and global representation shortcomings in today’s open model ecosystem. |
| Outcome: | The proposed model is pretrained on openly available data and suppresses verbatim recall of data while retaining task performance. |